[Doc] Fix links in doc

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2151

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 16 Unrelated Failures

As of commit 7b64624 with merge base 6822468 ():

NEW FAILURE - The following job has failed:

• Unit-tests on Windows / unittests-cpu / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• Examples Tests on Linux / tests (3.9, 12.1) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Generate documentation / build-docs (3.9, 12.1) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Libs Tests on Linux / unittests-sklearn (3.9, 12.1) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Lint / c-source / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Lint / python-source-and-configs / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Unit-tests on Linux / tests-cpu (3.8) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Unit-tests on Linux / tests-cpu (3.9) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Unit-tests on Linux / tests-gpu (3.10, 12.1) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	54.0113ms	53.5387ms	18.6781 Ops/s	18.6158 Ops/s	$\color{#35bf28}+0.33\%$
test_sync	31.0711ms	29.0577ms	34.4143 Ops/s	33.5028 Ops/s	$\color{#35bf28}+2.72\%$
test_async	71.2342ms	31.0028ms	32.2551 Ops/s	37.9925 Ops/s	$\textbf{\color{#d91a1a}-15.10\%}$
test_simple	0.4039s	0.3492s	2.8641 Ops/s	3.0111 Ops/s	$\color{#d91a1a}-4.88\%$
test_transformed	0.4867s	0.4841s	2.0656 Ops/s	2.0401 Ops/s	$\color{#35bf28}+1.25\%$
test_serial	1.2646s	1.2172s	0.8215 Ops/s	0.8273 Ops/s	$\color{#d91a1a}-0.70\%$
test_parallel	1.0462s	1.0097s	0.9903 Ops/s	0.9831 Ops/s	$\color{#35bf28}+0.74\%$
test_step_mdp_speed[True-True-True-True-True]	0.1626ms	21.6357μs	46.2199 KOps/s	46.5060 KOps/s	$\color{#d91a1a}-0.62\%$
test_step_mdp_speed[True-True-True-True-False]	37.4110μs	13.1626μs	75.9730 KOps/s	76.8693 KOps/s	$\color{#d91a1a}-1.17\%$
test_step_mdp_speed[True-True-True-False-True]	54.4820μs	12.6113μs	79.2940 KOps/s	78.9507 KOps/s	$\color{#35bf28}+0.43\%$
test_step_mdp_speed[True-True-True-False-False]	28.0320μs	7.6934μs	129.9820 KOps/s	131.4303 KOps/s	$\color{#d91a1a}-1.10\%$
test_step_mdp_speed[True-True-False-True-True]	56.1560μs	22.7678μs	43.9217 KOps/s	44.3788 KOps/s	$\color{#d91a1a}-1.03\%$
test_step_mdp_speed[True-True-False-True-False]	57.8380μs	14.4633μs	69.1405 KOps/s	70.1534 KOps/s	$\color{#d91a1a}-1.44\%$
test_step_mdp_speed[True-True-False-False-True]	36.6990μs	13.9920μs	71.4695 KOps/s	71.9121 KOps/s	$\color{#d91a1a}-0.62\%$
test_step_mdp_speed[True-True-False-False-False]	42.9410μs	8.9122μs	112.2058 KOps/s	112.9452 KOps/s	$\color{#d91a1a}-0.65\%$
test_step_mdp_speed[True-False-True-True-True]	61.6660μs	24.2433μs	41.2485 KOps/s	42.0148 KOps/s	$\color{#d91a1a}-1.82\%$
test_step_mdp_speed[True-False-True-True-False]	48.3500μs	15.8996μs	62.8948 KOps/s	64.6523 KOps/s	$\color{#d91a1a}-2.72\%$
test_step_mdp_speed[True-False-True-False-True]	45.7760μs	13.9200μs	71.8392 KOps/s	72.3976 KOps/s	$\color{#d91a1a}-0.77\%$
test_step_mdp_speed[True-False-True-False-False]	27.3210μs	8.9033μs	112.3179 KOps/s	112.7625 KOps/s	$\color{#d91a1a}-0.39\%$
test_step_mdp_speed[True-False-False-True-True]	58.3990μs	25.5332μs	39.1647 KOps/s	39.7556 KOps/s	$\color{#d91a1a}-1.49\%$
test_step_mdp_speed[True-False-False-True-False]	59.0710μs	16.9370μs	59.0423 KOps/s	59.7468 KOps/s	$\color{#d91a1a}-1.18\%$
test_step_mdp_speed[True-False-False-False-True]	50.1540μs	14.9781μs	66.7640 KOps/s	67.0163 KOps/s	$\color{#d91a1a}-0.38\%$
test_step_mdp_speed[True-False-False-False-False]	33.0520μs	10.1369μs	98.6497 KOps/s	99.9744 KOps/s	$\color{#d91a1a}-1.32\%$
test_step_mdp_speed[False-True-True-True-True]	57.0560μs	24.1583μs	41.3937 KOps/s	42.1039 KOps/s	$\color{#d91a1a}-1.69\%$
test_step_mdp_speed[False-True-True-True-False]	85.0530μs	15.8723μs	63.0030 KOps/s	64.0840 KOps/s	$\color{#d91a1a}-1.69\%$
test_step_mdp_speed[False-True-True-False-True]	58.8800μs	15.8153μs	63.2298 KOps/s	62.8668 KOps/s	$\color{#35bf28}+0.58\%$
test_step_mdp_speed[False-True-True-False-False]	33.7130μs	10.1291μs	98.7252 KOps/s	99.2082 KOps/s	$\color{#d91a1a}-0.49\%$
test_step_mdp_speed[False-True-False-True-True]	56.2150μs	25.4411μs	39.3065 KOps/s	40.1079 KOps/s	$\color{#d91a1a}-2.00\%$
test_step_mdp_speed[False-True-False-True-False]	49.7030μs	16.7280μs	59.7802 KOps/s	59.8557 KOps/s	$\color{#d91a1a}-0.13\%$
test_step_mdp_speed[False-True-False-False-True]	61.3150μs	17.0931μs	58.5032 KOps/s	58.1474 KOps/s	$\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-True-False-False-False]	31.4990μs	11.2918μs	88.5597 KOps/s	88.9303 KOps/s	$\color{#d91a1a}-0.42\%$
test_step_mdp_speed[False-False-True-True-True]	59.6520μs	26.5416μs	37.6767 KOps/s	37.8839 KOps/s	$\color{#d91a1a}-0.55\%$
test_step_mdp_speed[False-False-True-True-False]	41.4570μs	18.2569μs	54.7739 KOps/s	56.2083 KOps/s	$\color{#d91a1a}-2.55\%$
test_step_mdp_speed[False-False-True-False-True]	50.8460μs	17.1953μs	58.1553 KOps/s	58.8000 KOps/s	$\color{#d91a1a}-1.10\%$
test_step_mdp_speed[False-False-True-False-False]	34.8150μs	11.3246μs	88.3030 KOps/s	87.9883 KOps/s	$\color{#35bf28}+0.36\%$
test_step_mdp_speed[False-False-False-True-True]	53.5300μs	27.3927μs	36.5061 KOps/s	37.7353 KOps/s	$\color{#d91a1a}-3.26\%$
test_step_mdp_speed[False-False-False-True-False]	46.9880μs	18.9595μs	52.7441 KOps/s	53.1362 KOps/s	$\color{#d91a1a}-0.74\%$
test_step_mdp_speed[False-False-False-False-True]	52.2880μs	18.1156μs	55.2010 KOps/s	54.1627 KOps/s	$\color{#35bf28}+1.92\%$
test_step_mdp_speed[False-False-False-False-False]	33.0120μs	12.3194μs	81.1725 KOps/s	82.2502 KOps/s	$\color{#d91a1a}-1.31\%$
test_values[generalized_advantage_estimate-True-True]	9.7359ms	9.3434ms	107.0279 Ops/s	106.1818 Ops/s	$\color{#35bf28}+0.80\%$
test_values[vec_generalized_advantage_estimate-True-True]	36.5435ms	35.1875ms	28.4192 Ops/s	28.3319 Ops/s	$\color{#35bf28}+0.31\%$
test_values[td0_return_estimate-False-False]	0.2035ms	0.1645ms	6.0774 KOps/s	6.0227 KOps/s	$\color{#35bf28}+0.91\%$
test_values[td1_return_estimate-False-False]	26.5629ms	23.3885ms	42.7560 Ops/s	42.0093 Ops/s	$\color{#35bf28}+1.78\%$
test_values[vec_td1_return_estimate-False-False]	38.7882ms	35.2515ms	28.3676 Ops/s	28.1650 Ops/s	$\color{#35bf28}+0.72\%$
test_values[td_lambda_return_estimate-True-False]	42.3902ms	34.0958ms	29.3291 Ops/s	29.2535 Ops/s	$\color{#35bf28}+0.26\%$
test_values[vec_td_lambda_return_estimate-True-False]	37.2335ms	35.2428ms	28.3746 Ops/s	27.8568 Ops/s	$\color{#35bf28}+1.86\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	8.3959ms	8.2141ms	121.7414 Ops/s	120.9978 Ops/s	$\color{#35bf28}+0.61\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.2898ms	1.9343ms	516.9863 Ops/s	489.7377 Ops/s	$\textbf{\color{#35bf28}+5.56\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.5469ms	0.3562ms	2.8073 KOps/s	2.8326 KOps/s	$\color{#d91a1a}-0.89\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	50.8028ms	47.5866ms	21.0143 Ops/s	21.3842 Ops/s	$\color{#d91a1a}-1.73\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	4.1691ms	3.0431ms	328.6069 Ops/s	330.3667 Ops/s	$\color{#d91a1a}-0.53\%$
test_dqn_speed	4.2845ms	1.4057ms	711.3917 Ops/s	740.0668 Ops/s	$\color{#d91a1a}-3.87\%$
test_ddpg_speed	3.1076ms	2.8792ms	347.3243 Ops/s	349.5345 Ops/s	$\color{#d91a1a}-0.63\%$
test_sac_speed	12.1518ms	8.7979ms	113.6635 Ops/s	117.2870 Ops/s	$\color{#d91a1a}-3.09\%$
test_redq_speed	14.2042ms	13.0650ms	76.5406 Ops/s	71.6224 Ops/s	$\textbf{\color{#35bf28}+6.87\%}$
test_redq_deprec_speed	14.9659ms	13.3959ms	74.6495 Ops/s	74.8915 Ops/s	$\color{#d91a1a}-0.32\%$
test_td3_speed	8.7279ms	8.4577ms	118.2349 Ops/s	118.4458 Ops/s	$\color{#d91a1a}-0.18\%$
test_cql_speed	38.0579ms	36.6503ms	27.2849 Ops/s	27.2457 Ops/s	$\color{#35bf28}+0.14\%$
test_a2c_speed	8.1622ms	7.4788ms	133.7105 Ops/s	134.0459 Ops/s	$\color{#d91a1a}-0.25\%$
test_ppo_speed	9.1906ms	7.7265ms	129.4240 Ops/s	130.0899 Ops/s	$\color{#d91a1a}-0.51\%$
test_reinforce_speed	7.8899ms	6.6654ms	150.0296 Ops/s	150.7540 Ops/s	$\color{#d91a1a}-0.48\%$
test_iql_speed	33.8916ms	32.6896ms	30.5908 Ops/s	30.4374 Ops/s	$\color{#35bf28}+0.50\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.1602ms	2.0936ms	477.6475 Ops/s	466.1614 Ops/s	$\color{#35bf28}+2.46\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.9122ms	0.4997ms	2.0013 KOps/s	2.0118 KOps/s	$\color{#d91a1a}-0.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7081ms	0.4746ms	2.1068 KOps/s	2.0968 KOps/s	$\color{#35bf28}+0.48\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.4034ms	2.1066ms	474.6982 Ops/s	467.2138 Ops/s	$\color{#35bf28}+1.60\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.0052ms	0.4906ms	2.0382 KOps/s	2.0200 KOps/s	$\color{#35bf28}+0.90\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6545ms	0.4708ms	2.1239 KOps/s	2.1218 KOps/s	$\color{#35bf28}+0.10\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.6639ms	1.2491ms	800.5835 Ops/s	809.9477 Ops/s	$\color{#d91a1a}-1.16\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.3805ms	1.1728ms	852.6665 Ops/s	847.1712 Ops/s	$\color{#35bf28}+0.65\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.4421ms	2.2347ms	447.4786 Ops/s	449.0288 Ops/s	$\color{#d91a1a}-0.35\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0132ms	0.6170ms	1.6206 KOps/s	1.6149 KOps/s	$\color{#35bf28}+0.36\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8548ms	0.5932ms	1.6857 KOps/s	1.6954 KOps/s	$\color{#d91a1a}-0.57\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.2631ms	2.0681ms	483.5449 Ops/s	470.4170 Ops/s	$\color{#35bf28}+2.79\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.9608ms	0.4975ms	2.0102 KOps/s	1.9900 KOps/s	$\color{#35bf28}+1.02\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7886ms	0.4782ms	2.0913 KOps/s	2.0992 KOps/s	$\color{#d91a1a}-0.38\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.3211ms	2.0600ms	485.4366 Ops/s	475.1289 Ops/s	$\color{#35bf28}+2.17\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.6266ms	0.4919ms	2.0328 KOps/s	2.0159 KOps/s	$\color{#35bf28}+0.84\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.4039ms	0.4777ms	2.0935 KOps/s	2.1271 KOps/s	$\color{#d91a1a}-1.58\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	5.0377ms	2.2255ms	449.3426 Ops/s	450.6128 Ops/s	$\color{#d91a1a}-0.28\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.1823ms	0.6218ms	1.6082 KOps/s	1.6246 KOps/s	$\color{#d91a1a}-1.01\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.7324ms	0.5941ms	1.6833 KOps/s	1.6653 KOps/s	$\color{#35bf28}+1.08\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1095s	7.6568ms	130.6035 Ops/s	130.2987 Ops/s	$\color{#35bf28}+0.23\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	13.8888ms	11.8364ms	84.4855 Ops/s	83.4634 Ops/s	$\color{#35bf28}+1.22\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	1.5944ms	1.1004ms	908.7925 Ops/s	961.9606 Ops/s	$\textbf{\color{#d91a1a}-5.53\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	93.3367ms	5.4454ms	183.6398 Ops/s	179.7740 Ops/s	$\color{#35bf28}+2.15\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1058s	13.6855ms	73.0699 Ops/s	83.1406 Ops/s	$\textbf{\color{#d91a1a}-12.11\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	3.6959ms	1.1475ms	871.4513 Ops/s	969.2462 Ops/s	$\textbf{\color{#d91a1a}-10.09\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	98.5647ms	5.9064ms	169.3080 Ops/s	125.6435 Ops/s	$\textbf{\color{#35bf28}+34.75\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	14.2826ms	12.1588ms	82.2453 Ops/s	80.3517 Ops/s	$\color{#35bf28}+2.36\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	4.0535ms	1.4741ms	678.3761 Ops/s	694.1084 Ops/s	$\color{#d91a1a}-2.27\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}5$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1015s	0.1014s	9.8629 Ops/s	9.8170 Ops/s	$\color{#35bf28}+0.47\%$
test_sync	94.5759ms	94.3017ms	10.6043 Ops/s	10.6318 Ops/s	$\color{#d91a1a}-0.26\%$
test_async	0.1764s	89.2089ms	11.2096 Ops/s	11.1902 Ops/s	$\color{#35bf28}+0.17\%$
test_single_pixels	0.1139s	0.1137s	8.7957 Ops/s	8.7338 Ops/s	$\color{#35bf28}+0.71\%$
test_sync_pixels	82.3338ms	75.6398ms	13.2206 Ops/s	13.2103 Ops/s	$\color{#35bf28}+0.08\%$
test_async_pixels	0.1539s	66.1335ms	15.1209 Ops/s	13.8817 Ops/s	$\textbf{\color{#35bf28}+8.93\%}$
test_simple	0.7463s	0.6908s	1.4477 Ops/s	1.4877 Ops/s	$\color{#d91a1a}-2.69\%$
test_transformed	0.9638s	0.9040s	1.1062 Ops/s	1.1046 Ops/s	$\color{#35bf28}+0.14\%$
test_serial	2.1819s	2.1395s	0.4674 Ops/s	0.4684 Ops/s	$\color{#d91a1a}-0.22\%$
test_parallel	2.2734s	2.2188s	0.4507 Ops/s	0.4511 Ops/s	$\color{#d91a1a}-0.08\%$
test_step_mdp_speed[True-True-True-True-True]	0.1018ms	27.0550μs	36.9618 KOps/s	37.5434 KOps/s	$\color{#d91a1a}-1.55\%$
test_step_mdp_speed[True-True-True-True-False]	32.2700μs	16.0471μs	62.3166 KOps/s	61.7326 KOps/s	$\color{#35bf28}+0.95\%$
test_step_mdp_speed[True-True-True-False-True]	43.7010μs	15.4667μs	64.6551 KOps/s	65.4788 KOps/s	$\color{#d91a1a}-1.26\%$
test_step_mdp_speed[True-True-True-False-False]	24.1410μs	9.2141μs	108.5297 KOps/s	106.4130 KOps/s	$\color{#35bf28}+1.99\%$
test_step_mdp_speed[True-True-False-True-True]	43.4920μs	27.6402μs	36.1791 KOps/s	35.3884 KOps/s	$\color{#35bf28}+2.23\%$
test_step_mdp_speed[True-True-False-True-False]	42.1310μs	17.4426μs	57.3310 KOps/s	57.5624 KOps/s	$\color{#d91a1a}-0.40\%$
test_step_mdp_speed[True-True-False-False-True]	34.7710μs	16.8750μs	59.2593 KOps/s	60.7666 KOps/s	$\color{#d91a1a}-2.48\%$
test_step_mdp_speed[True-True-False-False-False]	28.0110μs	10.7454μs	93.0630 KOps/s	92.1392 KOps/s	$\color{#35bf28}+1.00\%$
test_step_mdp_speed[True-False-True-True-True]	53.1700μs	29.1315μs	34.3272 KOps/s	34.6499 KOps/s	$\color{#d91a1a}-0.93\%$
test_step_mdp_speed[True-False-True-True-False]	36.2110μs	19.2727μs	51.8868 KOps/s	52.8610 KOps/s	$\color{#d91a1a}-1.84\%$
test_step_mdp_speed[True-False-True-False-True]	33.0510μs	16.5360μs	60.4742 KOps/s	61.1012 KOps/s	$\color{#d91a1a}-1.03\%$
test_step_mdp_speed[True-False-True-False-False]	33.9110μs	10.7450μs	93.0667 KOps/s	93.8197 KOps/s	$\color{#d91a1a}-0.80\%$
test_step_mdp_speed[True-False-False-True-True]	48.0210μs	30.9878μs	32.2708 KOps/s	32.7261 KOps/s	$\color{#d91a1a}-1.39\%$
test_step_mdp_speed[True-False-False-True-False]	43.8010μs	21.3385μs	46.8637 KOps/s	48.3600 KOps/s	$\color{#d91a1a}-3.09\%$
test_step_mdp_speed[True-False-False-False-True]	35.5390μs	18.0528μs	55.3932 KOps/s	55.4391 KOps/s	$\color{#d91a1a}-0.08\%$
test_step_mdp_speed[True-False-False-False-False]	26.3310μs	12.1874μs	82.0523 KOps/s	80.1964 KOps/s	$\color{#35bf28}+2.31\%$
test_step_mdp_speed[False-True-True-True-True]	46.6700μs	29.4790μs	33.9224 KOps/s	34.5713 KOps/s	$\color{#d91a1a}-1.88\%$
test_step_mdp_speed[False-True-True-True-False]	42.7310μs	19.0730μs	52.4301 KOps/s	52.6641 KOps/s	$\color{#d91a1a}-0.44\%$
test_step_mdp_speed[False-True-True-False-True]	44.6810μs	19.2591μs	51.9235 KOps/s	52.0806 KOps/s	$\color{#d91a1a}-0.30\%$
test_step_mdp_speed[False-True-True-False-False]	32.6510μs	12.3927μs	80.6930 KOps/s	82.4203 KOps/s	$\color{#d91a1a}-2.10\%$
test_step_mdp_speed[False-True-False-True-True]	48.1020μs	30.5909μs	32.6895 KOps/s	32.7914 KOps/s	$\color{#d91a1a}-0.31\%$
test_step_mdp_speed[False-True-False-True-False]	36.8910μs	20.5728μs	48.6078 KOps/s	48.6570 KOps/s	$\color{#d91a1a}-0.10\%$
test_step_mdp_speed[False-True-False-False-True]	41.2500μs	21.1181μs	47.3528 KOps/s	47.2523 KOps/s	$\color{#35bf28}+0.21\%$
test_step_mdp_speed[False-True-False-False-False]	38.2110μs	13.9985μs	71.4363 KOps/s	72.6243 KOps/s	$\color{#d91a1a}-1.64\%$
test_step_mdp_speed[False-False-True-True-True]	50.9200μs	32.4578μs	30.8093 KOps/s	31.0303 KOps/s	$\color{#d91a1a}-0.71\%$
test_step_mdp_speed[False-False-True-True-False]	52.9320μs	22.3646μs	44.7136 KOps/s	45.1423 KOps/s	$\color{#d91a1a}-0.95\%$
test_step_mdp_speed[False-False-True-False-True]	46.5810μs	21.6688μs	46.1493 KOps/s	46.3044 KOps/s	$\color{#d91a1a}-0.33\%$
test_step_mdp_speed[False-False-True-False-False]	30.8100μs	13.9989μs	71.4343 KOps/s	70.9276 KOps/s	$\color{#35bf28}+0.71\%$
test_step_mdp_speed[False-False-False-True-True]	55.4600μs	34.1107μs	29.3163 KOps/s	29.3490 KOps/s	$\color{#d91a1a}-0.11\%$
test_step_mdp_speed[False-False-False-True-False]	50.2000μs	24.2631μs	41.2148 KOps/s	41.7301 KOps/s	$\color{#d91a1a}-1.24\%$
test_step_mdp_speed[False-False-False-False-True]	41.8710μs	22.7481μs	43.9597 KOps/s	43.7482 KOps/s	$\color{#35bf28}+0.48\%$
test_step_mdp_speed[False-False-False-False-False]	31.6710μs	15.2979μs	65.3684 KOps/s	65.2424 KOps/s	$\color{#35bf28}+0.19\%$
test_values[generalized_advantage_estimate-True-True]	23.0938ms	22.0708ms	45.3088 Ops/s	46.3076 Ops/s	$\color{#d91a1a}-2.16\%$
test_values[vec_generalized_advantage_estimate-True-True]	81.3075ms	3.1485ms	317.6134 Ops/s	308.7049 Ops/s	$\color{#35bf28}+2.89\%$
test_values[td0_return_estimate-False-False]	84.7410μs	56.2013μs	17.7932 KOps/s	17.4885 KOps/s	$\color{#35bf28}+1.74\%$
test_values[td1_return_estimate-False-False]	48.3510ms	46.5080ms	21.5017 Ops/s	21.5959 Ops/s	$\color{#d91a1a}-0.44\%$
test_values[vec_td1_return_estimate-False-False]	1.9472ms	1.6960ms	589.6290 Ops/s	587.6076 Ops/s	$\color{#35bf28}+0.34\%$
test_values[td_lambda_return_estimate-True-False]	78.1707ms	74.4737ms	13.4276 Ops/s	13.5284 Ops/s	$\color{#d91a1a}-0.75\%$
test_values[vec_td_lambda_return_estimate-True-False]	1.9398ms	1.7011ms	587.8588 Ops/s	586.4185 Ops/s	$\color{#35bf28}+0.25\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	20.7537ms	20.4917ms	48.8003 Ops/s	49.1839 Ops/s	$\color{#d91a1a}-0.78\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.8167ms	0.6244ms	1.6016 KOps/s	1.5944 KOps/s	$\color{#35bf28}+0.45\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.6815ms	0.5888ms	1.6983 KOps/s	1.6870 KOps/s	$\color{#35bf28}+0.67\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.4476ms	1.3927ms	718.0505 Ops/s	718.2708 Ops/s	$\color{#d91a1a}-0.03\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.8883ms	0.6063ms	1.6494 KOps/s	1.6448 KOps/s	$\color{#35bf28}+0.28\%$
test_dqn_speed	1.4307ms	1.2311ms	812.3011 Ops/s	777.5419 Ops/s	$\color{#35bf28}+4.47\%$
test_ddpg_speed	2.8141ms	2.5504ms	392.1002 Ops/s	381.6466 Ops/s	$\color{#35bf28}+2.74\%$
test_sac_speed	8.0911ms	7.3828ms	135.4497 Ops/s	131.7005 Ops/s	$\color{#35bf28}+2.85\%$
test_redq_speed	9.9877ms	9.3403ms	107.0632 Ops/s	106.8884 Ops/s	$\color{#35bf28}+0.16\%$
test_redq_deprec_speed	11.0186ms	10.4735ms	95.4795 Ops/s	95.5419 Ops/s	$\color{#d91a1a}-0.07\%$
test_td3_speed	7.5965ms	7.3936ms	135.2522 Ops/s	130.5561 Ops/s	$\color{#35bf28}+3.60\%$
test_cql_speed	25.4166ms	23.9763ms	41.7078 Ops/s	41.7447 Ops/s	$\color{#d91a1a}-0.09\%$
test_a2c_speed	5.6692ms	5.2153ms	191.7425 Ops/s	187.0767 Ops/s	$\color{#35bf28}+2.49\%$
test_ppo_speed	5.8768ms	5.4958ms	181.9569 Ops/s	176.0906 Ops/s	$\color{#35bf28}+3.33\%$
test_reinforce_speed	4.5401ms	4.3133ms	231.8418 Ops/s	226.9964 Ops/s	$\color{#35bf28}+2.13\%$
test_iql_speed	19.1201ms	18.3781ms	54.4125 Ops/s	52.8114 Ops/s	$\color{#35bf28}+3.03\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.5831ms	2.4408ms	409.7056 Ops/s	419.5695 Ops/s	$\color{#d91a1a}-2.35\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.1022s	0.6461ms	1.5479 KOps/s	1.5513 KOps/s	$\color{#d91a1a}-0.22\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6941ms	0.5395ms	1.8536 KOps/s	1.8435 KOps/s	$\color{#35bf28}+0.55\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.6224ms	2.4670ms	405.3530 Ops/s	415.7896 Ops/s	$\color{#d91a1a}-2.51\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.2527ms	0.5505ms	1.8165 KOps/s	1.7998 KOps/s	$\color{#35bf28}+0.93\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.7102ms	0.5342ms	1.8721 KOps/s	1.8572 KOps/s	$\color{#35bf28}+0.80\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.9000ms	1.3554ms	737.8074 Ops/s	699.7546 Ops/s	$\textbf{\color{#35bf28}+5.44\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.4652ms	1.3002ms	769.1272 Ops/s	764.3230 Ops/s	$\color{#35bf28}+0.63\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.7489ms	2.5427ms	393.2875 Ops/s	399.3378 Ops/s	$\color{#d91a1a}-1.52\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.8020ms	0.6752ms	1.4811 KOps/s	1.4834 KOps/s	$\color{#d91a1a}-0.15\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.3737ms	0.6608ms	1.5132 KOps/s	1.5170 KOps/s	$\color{#d91a1a}-0.25\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.5310ms	2.4167ms	413.7927 Ops/s	417.8940 Ops/s	$\color{#d91a1a}-0.98\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.7014ms	0.5606ms	1.7838 KOps/s	1.7768 KOps/s	$\color{#35bf28}+0.39\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.1895ms	0.5451ms	1.8345 KOps/s	1.8331 KOps/s	$\color{#35bf28}+0.07\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.6664ms	2.4772ms	403.6772 Ops/s	414.7522 Ops/s	$\color{#d91a1a}-2.67\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.2747ms	0.5531ms	1.8080 KOps/s	1.8133 KOps/s	$\color{#d91a1a}-0.29\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.7046ms	0.5379ms	1.8592 KOps/s	1.8309 KOps/s	$\color{#35bf28}+1.55\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.7001ms	2.5537ms	391.5874 Ops/s	389.3028 Ops/s	$\color{#35bf28}+0.59\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.8067ms	0.6769ms	1.4774 KOps/s	1.4394 KOps/s	$\color{#35bf28}+2.63\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.4296ms	0.6667ms	1.5000 KOps/s	1.4815 KOps/s	$\color{#35bf28}+1.25\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1313s	9.0411ms	110.6063 Ops/s	145.6315 Ops/s	$\textbf{\color{#d91a1a}-24.05\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	14.4227ms	12.2862ms	81.3921 Ops/s	66.9896 Ops/s	$\textbf{\color{#35bf28}+21.50\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	5.5548ms	1.2497ms	800.2220 Ops/s	878.7750 Ops/s	$\textbf{\color{#d91a1a}-8.94\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1128s	6.4516ms	154.9991 Ops/s	152.7468 Ops/s	$\color{#35bf28}+1.47\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	14.5634ms	12.3422ms	81.0228 Ops/s	79.5449 Ops/s	$\color{#35bf28}+1.86\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	2.1356ms	1.2011ms	832.5727 Ops/s	761.7526 Ops/s	$\textbf{\color{#35bf28}+9.30\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1151s	6.8865ms	145.2127 Ops/s	146.1348 Ops/s	$\color{#d91a1a}-0.63\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	15.0449ms	12.7040ms	78.7155 Ops/s	79.4388 Ops/s	$\color{#d91a1a}-0.91\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	2.6080ms	1.5466ms	646.5755 Ops/s	609.6068 Ops/s	$\textbf{\color{#35bf28}+6.06\%}$