Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: store benchmark result & compare with file #1

Open
hazcod opened this issue Jan 13, 2020 · 2 comments
Open

Feature request: store benchmark result & compare with file #1

hazcod opened this issue Jan 13, 2020 · 2 comments

Comments

@hazcod
Copy link
Contributor

hazcod commented Jan 13, 2020

Hi, love the project!
Is it an idea to keep the previous bench result in a file, e.g. .github/cob.yaml and compare that?
This way you don't always need to re-run the benchmark twice, and it allows to compare against other branches than master.

@knqyf263
Copy link
Owner

We can store it, but I'm afraid that the bench score varies due to the environment since CI service launches a bit different environment each time. Do you have any ideas?

@hazcod
Copy link
Contributor Author

hazcod commented Jan 19, 2020

Maybe turn on/off with a toggle and store the result under .cob/ or so?
In theory GHA should have the same virtual instances:

Each virtual machine has the same hardware resources available.

2-core CPU
7 GB of RAM memory
14 GB of SSD disk space

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants