Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Oct 25, 2025

No description provided.

@pytorch-bot
Copy link

pytorch-bot bot commented Oct 25, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3222

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 25, 2025
@vmoens vmoens force-pushed the fix-doc branch 2 times, most recently from 13f0dbc to 6338a89 Compare October 25, 2025 00:45
@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Oct 25, 2025
@vmoens vmoens merged commit 3d1748f into main Oct 25, 2025
86 of 103 checks passed
@github-actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}14$. Worsened: $\large\color{#d91a1a}18$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 86.2354μs 84.2978μs 11.8627 KOps/s 11.5663 KOps/s $\color{#35bf28}+2.56\%$
test_tensor_to_bytestream_speed[torch.save] 0.1424ms 0.1413ms 7.0785 KOps/s 6.8968 KOps/s $\color{#35bf28}+2.63\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1210s 0.1205s 8.3020 Ops/s 8.5015 Ops/s $\color{#d91a1a}-2.35\%$
test_tensor_to_bytestream_speed[numpy] 2.8114μs 2.8059μs 356.3931 KOps/s 361.1282 KOps/s $\color{#d91a1a}-1.31\%$
test_tensor_to_bytestream_speed[safetensors] 41.8739μs 41.4008μs 24.1541 KOps/s 23.1714 KOps/s $\color{#35bf28}+4.24\%$
test_simple 0.5538s 0.5529s 1.8087 Ops/s 1.7429 Ops/s $\color{#35bf28}+3.77\%$
test_transformed 1.1218s 1.1189s 0.8938 Ops/s 0.8806 Ops/s $\color{#35bf28}+1.50\%$
test_serial 1.6777s 1.6724s 0.5979 Ops/s 0.5925 Ops/s $\color{#35bf28}+0.91\%$
test_parallel 1.1731s 1.1021s 0.9073 Ops/s 0.9331 Ops/s $\color{#d91a1a}-2.76\%$
test_step_mdp_speed[True-True-True-True-True] 0.2125ms 45.5262μs 21.9654 KOps/s 21.9117 KOps/s $\color{#35bf28}+0.24\%$
test_step_mdp_speed[True-True-True-True-False] 58.1410μs 25.9407μs 38.5495 KOps/s 39.1306 KOps/s $\color{#d91a1a}-1.49\%$
test_step_mdp_speed[True-True-True-False-True] 55.8610μs 26.3589μs 37.9378 KOps/s 38.7726 KOps/s $\color{#d91a1a}-2.15\%$
test_step_mdp_speed[True-True-True-False-False] 39.8300μs 14.1714μs 70.5649 KOps/s 71.0588 KOps/s $\color{#d91a1a}-0.70\%$
test_step_mdp_speed[True-True-False-True-True] 0.1055ms 48.6609μs 20.5504 KOps/s 20.3982 KOps/s $\color{#35bf28}+0.75\%$
test_step_mdp_speed[True-True-False-True-False] 60.9510μs 28.3268μs 35.3022 KOps/s 35.5144 KOps/s $\color{#d91a1a}-0.60\%$
test_step_mdp_speed[True-True-False-False-True] 60.1410μs 28.5386μs 35.0402 KOps/s 35.2497 KOps/s $\color{#d91a1a}-0.59\%$
test_step_mdp_speed[True-True-False-False-False] 47.9510μs 17.0357μs 58.7003 KOps/s 59.0430 KOps/s $\color{#d91a1a}-0.58\%$
test_step_mdp_speed[True-False-True-True-True] 86.1510μs 51.8653μs 19.2807 KOps/s 19.3905 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-False-True-True-False] 65.4000μs 31.2368μs 32.0136 KOps/s 32.0739 KOps/s $\color{#d91a1a}-0.19\%$
test_step_mdp_speed[True-False-True-False-True] 67.0910μs 28.3091μs 35.3243 KOps/s 35.5060 KOps/s $\color{#d91a1a}-0.51\%$
test_step_mdp_speed[True-False-True-False-False] 45.8010μs 17.0042μs 58.8090 KOps/s 59.3445 KOps/s $\color{#d91a1a}-0.90\%$
test_step_mdp_speed[True-False-False-True-True] 0.1163ms 53.6692μs 18.6327 KOps/s 18.3078 KOps/s $\color{#35bf28}+1.77\%$
test_step_mdp_speed[True-False-False-True-False] 62.5300μs 33.8499μs 29.5422 KOps/s 29.1405 KOps/s $\color{#35bf28}+1.38\%$
test_step_mdp_speed[True-False-False-False-True] 71.5510μs 31.0897μs 32.1650 KOps/s 31.6376 KOps/s $\color{#35bf28}+1.67\%$
test_step_mdp_speed[True-False-False-False-False] 45.6000μs 19.7658μs 50.5924 KOps/s 51.2613 KOps/s $\color{#d91a1a}-1.30\%$
test_step_mdp_speed[False-True-True-True-True] 82.1010μs 51.1823μs 19.5380 KOps/s 19.6748 KOps/s $\color{#d91a1a}-0.70\%$
test_step_mdp_speed[False-True-True-True-False] 68.1300μs 31.5056μs 31.7404 KOps/s 32.7218 KOps/s $\color{#d91a1a}-3.00\%$
test_step_mdp_speed[False-True-True-False-True] 2.3838ms 32.9063μs 30.3893 KOps/s 30.7962 KOps/s $\color{#d91a1a}-1.32\%$
test_step_mdp_speed[False-True-True-False-False] 49.6610μs 19.2530μs 51.9401 KOps/s 53.8136 KOps/s $\color{#d91a1a}-3.48\%$
test_step_mdp_speed[False-True-False-True-True] 91.1610μs 54.6178μs 18.3091 KOps/s 18.6128 KOps/s $\color{#d91a1a}-1.63\%$
test_step_mdp_speed[False-True-False-True-False] 0.1050ms 33.9478μs 29.4570 KOps/s 29.4123 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[False-True-False-False-True] 67.7110μs 34.7921μs 28.7422 KOps/s 28.8444 KOps/s $\color{#d91a1a}-0.35\%$
test_step_mdp_speed[False-True-False-False-False] 56.3600μs 21.7548μs 45.9668 KOps/s 46.8033 KOps/s $\color{#d91a1a}-1.79\%$
test_step_mdp_speed[False-False-True-True-True] 0.1155ms 57.1885μs 17.4860 KOps/s 17.4620 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[False-False-True-True-False] 68.8210μs 37.1633μs 26.9083 KOps/s 27.0609 KOps/s $\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-False-True-False-True] 0.1072ms 35.1042μs 28.4866 KOps/s 29.2756 KOps/s $\color{#d91a1a}-2.70\%$
test_step_mdp_speed[False-False-True-False-False] 50.0210μs 21.5258μs 46.4559 KOps/s 46.9085 KOps/s $\color{#d91a1a}-0.96\%$
test_step_mdp_speed[False-False-False-True-True] 95.1410μs 59.1424μs 16.9083 KOps/s 16.9695 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[False-False-False-True-False] 73.6810μs 39.5622μs 25.2767 KOps/s 25.4784 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[False-False-False-False-True] 73.8310μs 37.2662μs 26.8339 KOps/s 26.9096 KOps/s $\color{#d91a1a}-0.28\%$
test_step_mdp_speed[False-False-False-False-False] 51.0110μs 24.2177μs 41.2921 KOps/s 41.5759 KOps/s $\color{#d91a1a}-0.68\%$
test_values[generalized_advantage_estimate-True-True] 10.3795ms 10.1739ms 98.2908 Ops/s 97.7393 Ops/s $\color{#35bf28}+0.56\%$
test_values[vec_generalized_advantage_estimate-True-True] 19.1644ms 17.5086ms 57.1147 Ops/s 57.4662 Ops/s $\color{#d91a1a}-0.61\%$
test_values[td0_return_estimate-False-False] 0.2241ms 0.1220ms 8.1983 KOps/s 8.0422 KOps/s $\color{#35bf28}+1.94\%$
test_values[td1_return_estimate-False-False] 28.6378ms 27.8998ms 35.8426 Ops/s 35.9881 Ops/s $\color{#d91a1a}-0.40\%$
test_values[vec_td1_return_estimate-False-False] 18.2935ms 17.6638ms 56.6129 Ops/s 56.9859 Ops/s $\color{#d91a1a}-0.65\%$
test_values[td_lambda_return_estimate-True-False] 43.0794ms 42.0543ms 23.7788 Ops/s 24.1441 Ops/s $\color{#d91a1a}-1.51\%$
test_values[vec_td_lambda_return_estimate-True-False] 18.0001ms 17.5602ms 56.9469 Ops/s 57.4407 Ops/s $\color{#d91a1a}-0.86\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.1438ms 8.8380ms 113.1479 Ops/s 113.8531 Ops/s $\color{#d91a1a}-0.62\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7304ms 1.5335ms 652.1146 Ops/s 653.3984 Ops/s $\color{#d91a1a}-0.20\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5007ms 0.4243ms 2.3567 KOps/s 2.3988 KOps/s $\color{#d91a1a}-1.75\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 30.2785ms 29.4511ms 33.9546 Ops/s 33.4840 Ops/s $\color{#35bf28}+1.41\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.8627ms 1.7248ms 579.7848 Ops/s 582.9370 Ops/s $\color{#d91a1a}-0.54\%$
test_dqn_speed[False-None] 6.3023ms 1.4331ms 697.7793 Ops/s 701.4392 Ops/s $\color{#d91a1a}-0.52\%$
test_dqn_speed[False-backward] 2.1103ms 1.9354ms 516.6961 Ops/s 511.9444 Ops/s $\color{#35bf28}+0.93\%$
test_dqn_speed[True-None] 0.6893ms 0.5275ms 1.8957 KOps/s 1.8979 KOps/s $\color{#d91a1a}-0.11\%$
test_dqn_speed[True-backward] 1.0185ms 0.9728ms 1.0280 KOps/s 945.7089 Ops/s $\textbf{\color{#35bf28}+8.70\%}$
test_dqn_speed[reduce-overhead-None] 0.5575ms 0.5068ms 1.9730 KOps/s 1.8824 KOps/s $\color{#35bf28}+4.81\%$
test_dqn_speed[reduce-overhead-backward] 0.9824ms 0.9532ms 1.0491 KOps/s 939.1394 Ops/s $\textbf{\color{#35bf28}+11.71\%}$
test_ddpg_speed[False-None] 3.2073ms 2.9057ms 344.1551 Ops/s 345.3122 Ops/s $\color{#d91a1a}-0.34\%$
test_ddpg_speed[False-backward] 4.2721ms 4.1289ms 242.1964 Ops/s 242.8444 Ops/s $\color{#d91a1a}-0.27\%$
test_ddpg_speed[True-None] 1.6127ms 1.3742ms 727.6738 Ops/s 705.4457 Ops/s $\color{#35bf28}+3.15\%$
test_ddpg_speed[True-backward] 2.5442ms 2.4066ms 415.5310 Ops/s 414.3308 Ops/s $\color{#35bf28}+0.29\%$
test_ddpg_speed[reduce-overhead-None] 1.7562ms 1.3721ms 728.8087 Ops/s 719.2374 Ops/s $\color{#35bf28}+1.33\%$
test_ddpg_speed[reduce-overhead-backward] 2.4698ms 2.4070ms 415.4572 Ops/s 420.8618 Ops/s $\color{#d91a1a}-1.28\%$
test_sac_speed[False-None] 8.4475ms 7.9668ms 125.5217 Ops/s 124.5637 Ops/s $\color{#35bf28}+0.77\%$
test_sac_speed[False-backward] 11.6572ms 11.3051ms 88.4554 Ops/s 88.4018 Ops/s $\color{#35bf28}+0.06\%$
test_sac_speed[True-None] 2.2753ms 2.1099ms 473.9490 Ops/s 469.4833 Ops/s $\color{#35bf28}+0.95\%$
test_sac_speed[True-backward] 4.3057ms 4.1293ms 242.1697 Ops/s 245.2933 Ops/s $\color{#d91a1a}-1.27\%$
test_sac_speed[reduce-overhead-None] 2.3191ms 2.1002ms 476.1439 Ops/s 468.4387 Ops/s $\color{#35bf28}+1.64\%$
test_sac_speed[reduce-overhead-backward] 4.1840ms 4.0898ms 244.5131 Ops/s 215.3218 Ops/s $\textbf{\color{#35bf28}+13.56\%}$
test_redq_speed[False-None] 13.4796ms 10.4516ms 95.6789 Ops/s 96.5958 Ops/s $\color{#d91a1a}-0.95\%$
test_redq_speed[False-backward] 20.9224ms 17.9646ms 55.6651 Ops/s 54.8926 Ops/s $\color{#35bf28}+1.41\%$
test_redq_speed[True-None] 4.5915ms 4.3796ms 228.3295 Ops/s 220.8438 Ops/s $\color{#35bf28}+3.39\%$
test_redq_speed[True-backward] 10.0928ms 9.8061ms 101.9779 Ops/s 99.9690 Ops/s $\color{#35bf28}+2.01\%$
test_redq_speed[reduce-overhead-None] 4.5558ms 4.3052ms 232.2754 Ops/s 228.6750 Ops/s $\color{#35bf28}+1.57\%$
test_redq_speed[reduce-overhead-backward] 10.2897ms 10.0682ms 99.3221 Ops/s 100.7646 Ops/s $\color{#d91a1a}-1.43\%$
test_redq_deprec_speed[False-None] 11.5021ms 11.0691ms 90.3413 Ops/s 90.4451 Ops/s $\color{#d91a1a}-0.11\%$
test_redq_deprec_speed[False-backward] 16.4793ms 16.0083ms 62.4675 Ops/s 62.5756 Ops/s $\color{#d91a1a}-0.17\%$
test_redq_deprec_speed[True-None] 3.8041ms 3.5954ms 278.1302 Ops/s 267.5156 Ops/s $\color{#35bf28}+3.97\%$
test_redq_deprec_speed[True-backward] 7.7593ms 7.5330ms 132.7501 Ops/s 113.1879 Ops/s $\textbf{\color{#35bf28}+17.28\%}$
test_redq_deprec_speed[reduce-overhead-None] 3.7865ms 3.5640ms 280.5826 Ops/s 284.2587 Ops/s $\color{#d91a1a}-1.29\%$
test_redq_deprec_speed[reduce-overhead-backward] 7.8511ms 7.5729ms 132.0491 Ops/s 129.5607 Ops/s $\color{#35bf28}+1.92\%$
test_td3_speed[False-None] 8.1920ms 8.0316ms 124.5081 Ops/s 119.4619 Ops/s $\color{#35bf28}+4.22\%$
test_td3_speed[False-backward] 11.5440ms 11.0243ms 90.7086 Ops/s 92.0395 Ops/s $\color{#d91a1a}-1.45\%$
test_td3_speed[True-None] 1.8368ms 1.7875ms 559.4473 Ops/s 557.8773 Ops/s $\color{#35bf28}+0.28\%$
test_td3_speed[True-backward] 3.7552ms 3.6116ms 276.8868 Ops/s 233.0814 Ops/s $\textbf{\color{#35bf28}+18.79\%}$
test_td3_speed[reduce-overhead-None] 1.8433ms 1.7615ms 567.6868 Ops/s 569.6591 Ops/s $\color{#d91a1a}-0.35\%$
test_td3_speed[reduce-overhead-backward] 3.7786ms 3.6103ms 276.9882 Ops/s 238.4893 Ops/s $\textbf{\color{#35bf28}+16.14\%}$
test_cql_speed[False-None] 30.3690ms 26.2946ms 38.0307 Ops/s 37.8337 Ops/s $\color{#35bf28}+0.52\%$
test_cql_speed[False-backward] 39.0995ms 35.5802ms 28.1055 Ops/s 27.8555 Ops/s $\color{#35bf28}+0.90\%$
test_cql_speed[True-None] 12.5667ms 12.2442ms 81.6711 Ops/s 79.8127 Ops/s $\color{#35bf28}+2.33\%$
test_cql_speed[True-backward] 19.5097ms 18.5307ms 53.9645 Ops/s 56.6991 Ops/s $\color{#d91a1a}-4.82\%$
test_cql_speed[reduce-overhead-None] 12.7956ms 12.4629ms 80.2382 Ops/s 86.4334 Ops/s $\textbf{\color{#d91a1a}-7.17\%}$
test_cql_speed[reduce-overhead-backward] 19.1391ms 18.3741ms 54.4243 Ops/s 58.4705 Ops/s $\textbf{\color{#d91a1a}-6.92\%}$
test_a2c_speed[False-None] 5.8315ms 5.3650ms 186.3933 Ops/s 194.9193 Ops/s $\color{#d91a1a}-4.37\%$
test_a2c_speed[False-backward] 12.3262ms 11.8483ms 84.4002 Ops/s 84.6487 Ops/s $\color{#d91a1a}-0.29\%$
test_a2c_speed[True-None] 3.9872ms 3.6630ms 273.0026 Ops/s 290.2549 Ops/s $\textbf{\color{#d91a1a}-5.94\%}$
test_a2c_speed[True-backward] 8.8597ms 8.5919ms 116.3889 Ops/s 109.4185 Ops/s $\textbf{\color{#35bf28}+6.37\%}$
test_a2c_speed[reduce-overhead-None] 3.8410ms 3.7074ms 269.7272 Ops/s 292.3215 Ops/s $\textbf{\color{#d91a1a}-7.73\%}$
test_a2c_speed[reduce-overhead-backward] 9.2493ms 8.8133ms 113.4645 Ops/s 118.2770 Ops/s $\color{#d91a1a}-4.07\%$
test_ppo_speed[False-None] 6.3102ms 5.9905ms 166.9299 Ops/s 178.0330 Ops/s $\textbf{\color{#d91a1a}-6.24\%}$
test_ppo_speed[False-backward] 13.1270ms 12.6855ms 78.8302 Ops/s 79.7199 Ops/s $\color{#d91a1a}-1.12\%$
test_ppo_speed[True-None] 4.7459ms 3.6712ms 272.3895 Ops/s 288.0124 Ops/s $\textbf{\color{#d91a1a}-5.42\%}$
test_ppo_speed[True-backward] 8.6534ms 8.4535ms 118.2947 Ops/s 122.6523 Ops/s $\color{#d91a1a}-3.55\%$
test_ppo_speed[reduce-overhead-None] 3.7610ms 3.6356ms 275.0542 Ops/s 295.0829 Ops/s $\textbf{\color{#d91a1a}-6.79\%}$
test_ppo_speed[reduce-overhead-backward] 9.2556ms 8.8026ms 113.6029 Ops/s 120.4567 Ops/s $\textbf{\color{#d91a1a}-5.69\%}$
test_reinforce_speed[False-None] 4.8553ms 4.5808ms 218.3009 Ops/s 234.1066 Ops/s $\textbf{\color{#d91a1a}-6.75\%}$
test_reinforce_speed[False-backward] 7.7624ms 7.4633ms 133.9892 Ops/s 139.7697 Ops/s $\color{#d91a1a}-4.14\%$
test_reinforce_speed[True-None] 3.0869ms 2.8606ms 349.5745 Ops/s 379.0851 Ops/s $\textbf{\color{#d91a1a}-7.78\%}$
test_reinforce_speed[True-backward] 8.2412ms 7.7038ms 129.8057 Ops/s 136.1899 Ops/s $\color{#d91a1a}-4.69\%$
test_reinforce_speed[reduce-overhead-None] 3.0051ms 2.8650ms 349.0445 Ops/s 338.4724 Ops/s $\color{#35bf28}+3.12\%$
test_reinforce_speed[reduce-overhead-backward] 8.1433ms 7.8149ms 127.9614 Ops/s 126.9755 Ops/s $\color{#35bf28}+0.78\%$
test_iql_speed[False-None] 25.5363ms 19.9679ms 50.0804 Ops/s 49.7133 Ops/s $\color{#35bf28}+0.74\%$
test_iql_speed[False-backward] 32.2931ms 30.5991ms 32.6807 Ops/s 32.7781 Ops/s $\color{#d91a1a}-0.30\%$
test_iql_speed[True-None] 8.9969ms 8.4690ms 118.0774 Ops/s 118.7032 Ops/s $\color{#d91a1a}-0.53\%$
test_iql_speed[True-backward] 17.1390ms 16.6976ms 59.8887 Ops/s 59.6266 Ops/s $\color{#35bf28}+0.44\%$
test_iql_speed[reduce-overhead-None] 8.7690ms 8.4688ms 118.0806 Ops/s 116.8700 Ops/s $\color{#35bf28}+1.04\%$
test_iql_speed[reduce-overhead-backward] 17.6173ms 17.1361ms 58.3563 Ops/s 58.5266 Ops/s $\color{#d91a1a}-0.29\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.6039ms 6.0447ms 165.4340 Ops/s 166.4995 Ops/s $\color{#d91a1a}-0.64\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.5971ms 0.3613ms 2.7676 KOps/s 2.7341 KOps/s $\color{#35bf28}+1.23\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5650ms 0.3432ms 2.9134 KOps/s 2.8718 KOps/s $\color{#35bf28}+1.45\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.9748ms 5.7563ms 173.7227 Ops/s 175.9252 Ops/s $\color{#d91a1a}-1.25\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.5782s 0.6586ms 1.5185 KOps/s 3.1191 KOps/s $\textbf{\color{#d91a1a}-51.32\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5461ms 0.2945ms 3.3954 KOps/s 3.3626 KOps/s $\color{#35bf28}+0.97\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.4553ms 1.2731ms 785.4974 Ops/s 687.7320 Ops/s $\textbf{\color{#35bf28}+14.22\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4052ms 1.1921ms 838.8597 Ops/s 740.6695 Ops/s $\textbf{\color{#35bf28}+13.26\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.0461ms 5.9286ms 168.6747 Ops/s 171.1156 Ops/s $\color{#d91a1a}-1.43\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.1447ms 0.4703ms 2.1262 KOps/s 1.9641 KOps/s $\textbf{\color{#35bf28}+8.26\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7066ms 0.4499ms 2.2229 KOps/s 2.2651 KOps/s $\color{#d91a1a}-1.86\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.9058ms 5.7843ms 172.8819 Ops/s 175.5920 Ops/s $\color{#d91a1a}-1.54\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.9550ms 0.3089ms 3.2373 KOps/s 802.0855 Ops/s $\textbf{\color{#35bf28}+303.61\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6085ms 0.3296ms 3.0341 KOps/s 3.9198 KOps/s $\textbf{\color{#d91a1a}-22.59\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.9718ms 5.7442ms 174.0873 Ops/s 173.0055 Ops/s $\color{#35bf28}+0.63\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7776ms 0.3144ms 3.1804 KOps/s 3.6662 KOps/s $\textbf{\color{#d91a1a}-13.25\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5554ms 0.3101ms 3.2249 KOps/s 3.9736 KOps/s $\textbf{\color{#d91a1a}-18.84\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.2194ms 6.0324ms 165.7707 Ops/s 167.7551 Ops/s $\color{#d91a1a}-1.18\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9134ms 0.4293ms 2.3294 KOps/s 2.3462 KOps/s $\color{#d91a1a}-0.72\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6955ms 0.4514ms 2.2154 KOps/s 2.4104 KOps/s $\textbf{\color{#d91a1a}-8.09\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.5086s 15.1416ms 66.0432 Ops/s 194.1137 Ops/s $\textbf{\color{#d91a1a}-65.98\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 9.7133ms 2.0887ms 478.7637 Ops/s 438.6937 Ops/s $\textbf{\color{#35bf28}+9.13\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.6315ms 1.2229ms 817.7427 Ops/s 838.1766 Ops/s $\color{#d91a1a}-2.44\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 6.8438ms 5.1037ms 195.9378 Ops/s 56.1608 Ops/s $\textbf{\color{#35bf28}+248.89\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 9.6678ms 2.0940ms 477.5522 Ops/s 487.8907 Ops/s $\color{#d91a1a}-2.12\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.2707ms 1.2536ms 797.7135 Ops/s 882.3849 Ops/s $\textbf{\color{#d91a1a}-9.60\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 6.8472ms 5.3145ms 188.1629 Ops/s 185.5036 Ops/s $\color{#35bf28}+1.43\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.4808s 11.6961ms 85.4986 Ops/s 450.1675 Ops/s $\textbf{\color{#d91a1a}-81.01\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.2200ms 1.0078ms 992.2587 Ops/s 799.7808 Ops/s $\textbf{\color{#35bf28}+24.07\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 35.2014ms 32.9736ms 30.3273 Ops/s 30.0352 Ops/s $\color{#35bf28}+0.97\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.4180ms 18.1068ms 55.2280 Ops/s 56.5083 Ops/s $\color{#d91a1a}-2.27\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 36.1371ms 33.6329ms 29.7328 Ops/s 29.1372 Ops/s $\color{#35bf28}+2.04\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.4500ms 17.7504ms 56.3369 Ops/s 55.5521 Ops/s $\color{#35bf28}+1.41\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 37.9718ms 35.5114ms 28.1599 Ops/s 27.8568 Ops/s $\color{#35bf28}+1.09\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.8046ms 19.2426ms 51.9681 Ops/s 52.2979 Ops/s $\color{#d91a1a}-0.63\%$

vmoens added a commit that referenced this pull request Oct 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants