Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Define a benchmark for hp tuning things #13

Open
petermattson opened this issue Jun 13, 2018 · 1 comment
Open

Define a benchmark for hp tuning things #13

petermattson opened this issue Jun 13, 2018 · 1 comment
Labels
Backlog An issue to be discussed in a future Working Group, but not the immediate next one.

Comments

@petermattson
Copy link
Contributor

Have a simple starter benchmark for comparing different hyperparameter optimization systems e.g. from Google, SigOpt, .... and open source efforts like https://github.com/kubeflow/katib

Supporting orgs: Cisco

@petermattson petermattson added this to the v0.5 milestone Jun 13, 2018
@ddutta
Copy link

ddutta commented Jun 14, 2018

Task 0: Enumerate some candidate opensource efforts and algorithms for hyperparameter tuning algorithms that we could consider (in addition to commercial software e.g. SigOpt, Google)

Task 1: Enumerate hyperparams for the workloads we might want to tune and their well known values from practice e.g. a subset of the reference workloads where hyperparam tuning has been used successfully.

@petermattson petermattson removed this from the v0.5 milestone Jul 28, 2018
@petermattson petermattson changed the title Hyperparameter tuning benchmarks Define a benchmark for hp tuning things May 22, 2020
@petermattson petermattson added Backlog An issue to be discussed in a future Working Group, but not the immediate next one. and removed PM Action Item labels May 22, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Backlog An issue to be discussed in a future Working Group, but not the immediate next one.
Projects
None yet
Development

No branches or pull requests

2 participants