Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove parameter constraints when expanding model space in Adapter #3408

Closed
wants to merge 1 commit into from

Conversation

bletham
Copy link
Contributor

@bletham bletham commented Feb 21, 2025

Summary:
By default we expand range parameters in the model space so that the
training data include all modelable data, not just those that fall within the
box bounds.

A similar argument suggests that we should also include training data that
violate parameter constraints in the model. They are modelable and can be used
to improve predictions at points that satisfy parameter constraints.

We do this by simply dropping parameter constraints from the model space, if
the model space is specified to be expanded.

This will also fix #1568 . The issue there
is that generated points violated parameter constraints due to numerical
issues, and so then were left out of the training data and repeatedly
generated. With this change, those points would be included in the training
data and so likely not re-generated. Note, however, that the purpose of this
change is not just to fix this issue; it is a change that is right because it
better fits the concept of the modeling space.

Reviewed By: sdaulton, saitcakmak

Differential Revision: D69880066

Summary:
By default we expand range parameters in the model space so that the
training data include all modelable data, not just those that fall within the
box bounds.

A similar argument suggests that we should also include training data that
violate parameter constraints in the model. They are modelable and can be used
to improve predictions at points that satisfy parameter constraints.

We do this by simply dropping parameter constraints from the model space, if
the model space is specified to be expanded.

This will also fix facebook#1568 . The issue there
is that generated points violated parameter constraints due to numerical
issues, and so then were left out of the training data and repeatedly
generated. With this change, those points would be included in the training
data and so likely not re-generated. Note, however, that the purpose of this
change is not just to fix this issue; it is a change that is right because it
better fits the concept of the modeling space.

Reviewed By: sdaulton, saitcakmak

Differential Revision: D69880066
@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Feb 21, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69880066

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.99%. Comparing base (63a1eaf) to head (b703a56).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #3408   +/-   ##
=======================================
  Coverage   95.99%   95.99%           
=======================================
  Files         539      539           
  Lines       52794    52801    +7     
=======================================
+ Hits        50677    50684    +7     
  Misses       2117     2117           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69880066

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in d86a17b.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Out-of-design trials may cause repeated trials
3 participants