Continuous measurement #206
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…continuous expt feature. Much of the heavy lifting has been done, but changes still need to be verified, validated, and added to our automatic testing if possible. File changes to abstract expt include new continuous preallocate, reallocate, and continuous save point methods; to runinfo include a new continuous_expt boolean attribute, and to experiment.py allow for continuous expt runs.
…etting runinfo.continuous_expt to True, experimentalists can run their experiment designs continuously, and continue to extend their datasets indefinitely. This needs to be tested for how long/what number of continuous experiments can be run before the reallocation resizing bogs down, if ever. Also may want to consider changing the continuous_count var in experiment.py to a runinfo attribute to keep track of the number of repetitions without have to infer it through extraction of dataset size. I will likely find a solution for this where it will only added to continuous expts to not include it unnecessarily in the metadata of other experiments. Furthermore, not all data types/sizes have been tested with our new continuous_save_point function, and so one could still encounter bugs using this feature as we continue to flush it out. If so, please report them along with the circumstance you encountered it with in addition to the error message.
….run_count attribute for continuous experiments.
… the lower layers likely still need updating. Furthermore, modifying experiment to be able to test the increasing lag times between experiments. Pushing to test on cint-transport overnight, hopefully this will provide a consistent testing environment since my computer was lagging out and artificially increasing runtimes temporarily.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.