Skip to content

Commit

Permalink
try with simpleMetricRes
Browse files Browse the repository at this point in the history
  • Loading branch information
DawidNiezgodka committed Jan 22, 2024
1 parent daaa9fe commit d486fe7
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
4 changes: 2 additions & 2 deletions dist/index.js

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions src/comment.js
Original file line number Diff line number Diff line change
Expand Up @@ -289,8 +289,8 @@ module.exports.createBodyForComparisonWithJumpDeltas = function(evaluationResult
const metricName = evaluationParameters.metricNames[i];
const metricUnit = evaluationParameters.metricUnits[i];

const currValue = currentBenchmark.results[i].value;
const prevValue = previousBenchmark.results[i].value;
const currValue = currentBenchmark.simpleMetricResults[i].value;
const prevValue = previousBenchmark.simpleMetricResults[i].value;

const currPlusUnit = currValue + ' ' + metricUnit;
const prevPlusUnit = prevValue + ' ' + metricUnit;
Expand Down

1 comment on commit d486fe7

@DawidNiezgodka
Copy link
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark results

Benchmark group: MongoDB Benchmark

The chosen evaluation method is jump_detection.
For each metric, there is the following condition:
The current value should not change more than X% (Max. ch in the table below) from the value measured for the previous benchmark.

Current Benchmark Previous Benchmark
Execution time: 0m 11s Execution time: 0m 11s
Parametrization: Parametrization:
- storageEngine: N/A - storageEngine: N/A
- logVerbosity: N/A - logVerbosity: N/A
- bindIp: 0.0.0.0 - bindIp: 0.0.0.0
- port: 27017 - port: 27017
Other Info: YCSB Parameters: workload=workloada, recordcount=200000, threads=32, Other Info: YCSB Parameters: workload=workloada, recordcount=200000, threads=32,

Results

Metric Curr: d486fe7 Prev: 8f60099 Max. Jump Was Res
OVERALL Throughput 16747.613465081227 ops/sec 67213.42 ops/sec 10 75.08 🔴
[READ], AverageLatency(us) 1825.4436406295827 us 1810.7 us 10 0.81 🟢
[READ], MaxLatency(us) 87807 us 117887 us 10 25.52 🔴
[UPDATE], AverageLatency(us) 1871.9681377399565 us 1853.37 us 10 1.00 🟢
[UPDATE], MaxLatency(us) 151423 us 128631 us 10 17.72 🔴

Benchmark failed

The chosen failing condition was any.
At least one metric didn't pass the tests.

Please sign in to comment.