-
Notifications
You must be signed in to change notification settings - Fork 76
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
2 changed files
with
29 additions
and
47 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
a3595f4
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Possible performance regression was detected for benchmark 'CPU Benchmark Results'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold
2
.benchmarks/common/common_ops_test.py::test_plain_set_stack_nested
3419.7137298629254
iter/sec (stddev: 0.0003991740607016415
)7102.635672018859
iter/sec (stddev: 0.000003490104581926313
)2.08
benchmarks/common/common_ops_test.py::test_items_stack_nested_locked
656.343150461759
iter/sec (stddev: 0.0003111802618047426
)1331.741397657034
iter/sec (stddev: 0.000030312527898759866
)2.03
benchmarks/common/common_ops_test.py::test_keys_stack_nested_locked
788.6443206913364
iter/sec (stddev: 0.0003061982749919703
)1626.0407392109466
iter/sec (stddev: 0.000012775485021631076
)2.06
benchmarks/common/common_ops_test.py::test_values_stack_nested_locked
955.063108522064
iter/sec (stddev: 0.0004743697892677344
)2064.2310412001884
iter/sec (stddev: 0.000012551582401382587
)2.16
benchmarks/common/common_ops_test.py::test_setitem_dim[int]
17219.6549339233
iter/sec (stddev: 0.000035878887277692905
)37081.704008478664
iter/sec (stddev: 0.0000019449480172614492
)2.15
benchmarks/common/common_ops_test.py::test_setitem_dim[slice_int]
8719.754485117723
iter/sec (stddev: 0.00006578131347708857
)19100.86607737998
iter/sec (stddev: 0.000007366987788507623
)2.19
benchmarks/common/common_ops_test.py::test_setitem_dim[tuple]
11436.732419311986
iter/sec (stddev: 0.0000488122632059882
)24645.2337086472
iter/sec (stddev: 0.000003389822100687616
)2.15
benchmarks/common/common_ops_test.py::test_unbind_speed_stack1
644461.6098652725
iter/sec (stddev: 0.00003056490032461228
)1670689.808577556
iter/sec (stddev: 2.3238120703907647e-8
)2.59
benchmarks/common/memmap_benchmarks_test.py::test_creation[device0]
1504.858172785846
iter/sec (stddev: 0.0006393396980101482
)3439.973939450101
iter/sec (stddev: 0.00009263139975944315
)2.29
benchmarks/common/memmap_benchmarks_test.py::test_creation_from_tensor
1422.4732601074566
iter/sec (stddev: 0.0003778617584150533
)3130.170212285269
iter/sec (stddev: 0.000013151245167648012
)2.20
benchmarks/common/memmap_benchmarks_test.py::test_add_one[memmap_tensor0]
14247.64631363357
iter/sec (stddev: 0.00007170766678251406
)39703.09957082932
iter/sec (stddev: 0.000005248389106894473
)2.79
benchmarks/common/memmap_benchmarks_test.py::test_contiguous[memmap_tensor0]
70766.9207073084
iter/sec (stddev: 0.00007593331906997162
)173922.50384782036
iter/sec (stddev: 5.62562376421342e-7
)2.46
benchmarks/common/memmap_benchmarks_test.py::test_stack[memmap_tensor0]
20414.372737045724
iter/sec (stddev: 0.00004487886673659763
)54588.99227440141
iter/sec (stddev: 0.0000016336264114157033
)2.67
benchmarks/common/memmap_benchmarks_test.py::test_memmaptd_index_astensor
465.69216765587333
iter/sec (stddev: 0.000585917326871396
)1090.650647915972
iter/sec (stddev: 0.000018371014635300354
)2.34
benchmarks/common/memmap_benchmarks_test.py::test_memmaptd_index_op
172.08119090954335
iter/sec (stddev: 0.0014806015309059626
)446.8523829858738
iter/sec (stddev: 0.00006864059888340528
)2.60
benchmarks/common/pytree_benchmarks_test.py::test_add_pytree
12358.153554517876
iter/sec (stddev: 0.00011198467990816379
)30554.01449889499
iter/sec (stddev: 0.000003242521013973305
)2.47
benchmarks/common/pytree_benchmarks_test.py::test_add_td
8460.561779317395
iter/sec (stddev: 0.0001071044659562639
)17428.648656598485
iter/sec (stddev: 0.0000033848856519431052
)2.06
benchmarks/nn/functional_benchmarks_test.py::test_exec_functorch
3086.258152160973
iter/sec (stddev: 0.00031168353309776514
)6717.08248817304
iter/sec (stddev: 0.000005958601452842365
)2.18
benchmarks/nn/functional_benchmarks_test.py::test_exec_td
2983.778321124548
iter/sec (stddev: 0.00011444980913672227
)6904.0807872751775
iter/sec (stddev: 0.000006460462486537992
)2.31
benchmarks/nn/functional_benchmarks_test.py::test_vmap_mlp_speed[True-True]
509.5662314569196
iter/sec (stddev: 0.0007016200346563893
)1109.127969972082
iter/sec (stddev: 0.000030517185825485492
)2.18
benchmarks/nn/functional_benchmarks_test.py::test_vmap_mlp_speed[True-False]
905.4351794999594
iter/sec (stddev: 0.0006324626564469274
)2118.7321959016936
iter/sec (stddev: 0.000019325758496973623
)2.34
benchmarks/nn/functional_benchmarks_test.py::test_vmap_mlp_speed[False-True]
521.1566809138526
iter/sec (stddev: 0.0011074708019783673
)1287.1211815540744
iter/sec (stddev: 0.000024838200972154112
)2.47
benchmarks/nn/functional_benchmarks_test.py::test_vmap_mlp_speed[False-False]
1132.0401142067333
iter/sec (stddev: 0.0004904316698756558
)2629.0395966063325
iter/sec (stddev: 0.000020510632639301753
)2.32
This comment was automatically generated by workflow using github-action-benchmark.
CC: @vmoens