Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Figure out how to save and restore experiments in a cross-platform and 2-3 compatible way #17

Open
TheButlah opened this issue Oct 3, 2018 · 1 comment
Open

Figure out how to save and restore experiments in a cross-platform and 2-3 compatible way #17

TheButlah opened this issue Oct 3, 2018 · 1 comment
Labels
enhancement New feature or request framework A component of the RL framework help wanted Extra attention is needed
Milestone
Example code for ...

Comments

@TheButlah
Copy link
Owner

I'm currently writing up the code to perform the cart pole q-learning experiment. I want to be able to save and restore the experiment so that it can be resumed. We should figure out how to do that.
@TheButlah TheButlah added enhancement New feature or request help wanted Extra attention is needed framework A component of the RL framework labels Oct 3, 2018
@TheButlah
Copy link
Owner Author

Right now, I'm thinking that we can have each experiment go in a directory, and it would save everything like logs and the model checkpoints there. I'm just not sure how we would actually make it easy to restore from that - would there be a standardized process or would it be up to each model?

Additionally I'm using argparse to define all of the arguments. When restoring a model, the arguments should be loaded from that saved model, but some or all might be overwritten. How would that work?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request framework A component of the RL framework help wanted Extra attention is needed
Projects
None yet
Milestone
Example code for basic experimentatio...
Development

No branches or pull requests
1 participant
@TheButlah