Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(kore): ts interpreter fixes #196

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

paradite
Copy link
Contributor

Some issues surfaced when I started actual training, so here are the fixes.

@bovard kindly help review please.

So far the progress has been good with the new interpreter. Simulation is actually much faster than using kaggle-environments python cli. I will share the new DQN baseline setup soon on discussion forum.

@paradite paradite marked this pull request as draft April 25, 2022 07:35
@paradite
Copy link
Contributor Author

paradite commented Apr 25, 2022

I have encountered a new issue:
while the model does well against the starter bot / old agent in new step interpreter written in TS (during training and after-training evaluation), it is not performing as well in the python interpreter.

I suspect there are more major issues with the TS interpreter or the Board.next() implementation. Hence I am reverting this back to draft and taking a closer look.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant