Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Report benchmark statistics and comparison #137

Draft
wants to merge 5 commits into
base: master
Choose a base branch
from
Draft

Report benchmark statistics and comparison #137

wants to merge 5 commits into from

Conversation

luispfgarces
Copy link
Contributor

Description

Please include here a description of the changes introduced by your new pull request.

Remember, it is important to include as much information as possible on the context of the changes, so that we can properly review it.

Also mention any issues to be closed with this pull request: Closes #(issue number).

Change checklist

  • Code follows the code rules guidelines of this project
  • Commit messages follow the commit rules of this project
  • I have self-reviewed my changes before submitting this pull request
  • I have covered new/changed code with new tests and/or adjusted existent ones
  • I have made changes necessary to update the documentation accordingly

Please also check the I want to contribute guidelines and make sure you have done accordingly.

Disclaimer

By sending us your contributions, you are agreeing that your contribution is made subject to the terms of our Contributor Ownership Statement

@luispfgarces
ci: add benchmark report results to Markdown via custom PS script
fda7ffd 
chore: refactor benchmark report results generation

chore: add new job to run benchmarks and publish results to github pr comment

fix: change outputs notation

fix: resolve notation issue

fix: resolve mispelled outputs

fix: add missing git checkout action

fix: use dotnet command to run benchmarks

fix: publish benchmarks and run binary

fix: change to run benchmark with privileges

chore: add list commands

chore: run benchmarks with dotnet and dll

chore: run benchmarks as self-contained and remove bin folder

chore: run benchmarks as framework dependent

chore: change build & run benchmarks to run from csproj

fix: add missing project switch

fix: add framework to run command

feat: produce benchmarks report on markdown format

fix: fix null reference when there are statistics missing

chore: review file permissions and list all directories and sub-directories

chore: prefix paths from current folder

chore: change to path of results

chore: consolidate change directory and determine report file

fix: set artifacts folder on chmod

fix: fix report results file path

chore: change to use event number

feat: changes to add/update a single comment with benchmarks results

chore: fix static code analysis issues and remove old logic for running benchmarks
@luispfgarces luispfgarces mentioned this pull request Apr 10, 2023
Closed
5 tasks
@github-actions
Copy link

github-actions bot commented Apr 10, 2023 •
edited
Loading

Benchmark Results Report

Date & Time: 2023-04-10 21:37:06

Environment

BenchmarkDotNet Version=0.13.5

Processor=Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz,2 physical cores, 2 logical cores

Architecture=X64, Runtime=.NET 6.0.15 (6.0.1523.11507), Configuration=RELEASE

.NET CLI Version=7.0.202

Statistics

Name Parameters Mean Time Taken Std Error Branch
Instructions/Op		 Branch
Mispredictions/Op		 GC Gen0 Allocated Memory
Benchmark1.RunAsync [EnableCompilation=False] 27,702 ns 450 ns 0 0 0.4272 8794 B
Benchmark2.RunAsync [EnableCompilation=False] 156,257 ns 1,033 ns 0 0 2.9297 55919 B
Benchmark3.RunAsync [EnableCompilation=False] 3,724,889 ns 19,363 ns 0 0 85.9375 1623834 B
Benchmark1.RunAsync [EnableCompilation=True] 28,410 ns 378 ns 0 0 0.5188 9746 B
Benchmark2.RunAsync [EnableCompilation=True] 5,114,277 ns 28,238 ns 0 0 7.8125 270882 B
Benchmark3.RunAsync [EnableCompilation=True] 104,973,836 ns 588,151 ns 0 0 200.0000 6464525 B

Statistics Comparison

Name Baseline Compare Mean Time Taken
[Baseline]		 Mean Time Taken
[Compare]		 Mean Time Taken
[Comparison %]		 Allocated Memory
[Baseline]		 Allocated Memory
[Compare]		 Allocated Memory
[Comparison %]
Benchmark1.RunAsync [EnableCompilation=False] [EnableCompilation=True] 27,702 ns 28,410 ns -2.56 % 8794 B 9746 B -10.83 %
Benchmark2.RunAsync [EnableCompilation=False] [EnableCompilation=True] 156,257 ns 5,114,277 ns -3172.99 % 55919 B 270882 B -384.42 %
Benchmark3.RunAsync [EnableCompilation=False] [EnableCompilation=True] 3,724,889 ns 104,973,836 ns -2718.17 % 1623834 B 6464525 B -298.1 %

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@luispfgarces