Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove logspew from percentile es #3366

Closed
wants to merge 1 commit into from

Conversation

mpolson64
Copy link
Contributor

Summary:
Playing whack-a-mode with some logs while developing tutorials. Logs are in an unacceptable state and take up more than 99% of the page real estate before this diff, producing multiple logs per progression call to should_stop_trial_early regardless of whether anything happened. We do not need this much visibility on whether or not we decide to kill a trial.

In the tutorials we're working on (ex N6570044 we were seeing thousands of logs before this change, now we see a couple dozen).

Changes:

  • No longer log if there havent been enough completed trials to make an ES decision
  • No longer log if no trials have met minimum observed progressions
  • No longer log the value of every trial before we make an ES decision (this happened twice)
  • No longer log at the beginning of ever ES decision that we are about to make an ES decision
  • No longer log when we consider stopping a trial and chose not to (only log if we actually decide it should stop)
  • [RFC] No longer log if an error happened during interpolation and we decide to use uninterpolated values instead (its not clear to me how important this error is -- fwiw in the tutorial we run into this very frequently -- if its a real actionable issue we need to fix it)

Differential Revision: D69616469

Summary:
Playing whack-a-mode with some logs while developing tutorials. Logs are in an unacceptable state and take up more than 99% of the page real estate before this diff, producing multiple logs per progression call to `should_stop_trial_early` regardless of whether anything happened. We do not need this much visibility on whether or not we decide to kill a trial.

In the tutorials we're working on (ex N6570044 we were seeing thousands of logs before this change, now we see a couple dozen).

Changes:
* No longer log if there havent been enough completed trials to make an ES decision
* No longer log if no trials have met minimum observed progressions
* No longer log the value of every trial before we make an ES decision (this happened twice)
* No longer log at the beginning of ever ES decision that we are about to make an ES decision
* No longer log when we consider stopping a trial and chose not to (only log if we actually decide it should stop)
* [RFC] No longer log if an error happened during interpolation and we decide to use uninterpolated values instead (its not clear to me how important this error is -- fwiw in the tutorial we run into this very frequently -- if its a real actionable issue we need to fix it)

Differential Revision: D69616469
@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Feb 13, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69616469

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.73%. Comparing base (f7227a2) to head (e49fed5).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3366      +/-   ##
==========================================
- Coverage   95.73%   95.73%   -0.01%     
==========================================
  Files         534      534              
  Lines       52580    52564      -16     
==========================================
- Hits        50336    50320      -16     
  Misses       2244     2244              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 13ad726.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants