Skip to content

[Benchmark] Benchmark split and chunk (#564) #341

[Benchmark] Benchmark split and chunk (#564)

[Benchmark] Benchmark split and chunk (#564) #341

Triggered via push November 21, 2023 10:31
Status Failure
Total duration 8m 51s
Artifacts

benchmarks.yml

on: push
CPU Pytest benchmark
3m 53s
CPU Pytest benchmark
GPU Pytest benchmark
8m 42s
GPU Pytest benchmark
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 2 warnings
GPU Pytest benchmark
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
GPU Pytest benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'GPU Benchmark Results'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: a5bed018f3e589ea4e0c4e5321a165362a440a75 | Previous: e1f20f4722934c9dc7ebb8d75e2d898a29b57edf | Ratio | |-|-|-|-| | `benchmarks/common/common_ops_test.py::test_keys_nested_leaf` | `6012.397478118437` iter/sec (`stddev: 0.000003872820935640608`) | `12214.349670374433` iter/sec (`stddev: 0.000002600991620871067`) | `2.03` | | `benchmarks/nn/functional_benchmarks_test.py::test_tdmodule` | `11796.69315175139` iter/sec (`stddev: 0.0018184055517336617`) | `58064.722529576306` iter/sec (`stddev: 0.0000010512503394212976`) | `4.92` | This comment was automatically generated by [workflow](https://github.com/pytorch/tensordict/actions?query=workflow%3AContinuous%20Benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @vmoens Comment was generated at https://github.com/pytorch/tensordict/commit/a5bed018f3e589ea4e0c4e5321a165362a440a75#commitcomment-133146812
GPU Pytest benchmark
Performance alert! Previous value was 12214.349670374433 and current value is 6012.397478118437. It is 2.031527309168668x worse than previous exceeding a ratio threshold 2
GPU Pytest benchmark
Performance alert! Previous value was 58064.722529576306 and current value is 11796.69315175139. It is 4.922118578709981x worse than previous exceeding a ratio threshold 2