Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[CI] LLM tests integration #3216

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 8 commits into
base: gh/vmoens/166/base
Choose a base branch
from
Open

[CI] LLM tests integration #3216

wants to merge 8 commits into from

Conversation

vmoens
Copy link
Collaborator

@vmoens vmoens commented Oct 22, 2025 •
edited
Loading

@vmoens
Update
f5920a5 
[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Oct 22, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3216

Note: Links to docs will display an error until the docs builds have been completed.

❌ 8 New Failures, 3 Unrelated Failures

As of commit 847f875 with merge base 963fdd4 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 22, 2025
@vmoens vmoens added the llm/ci label Oct 22, 2025
This was referenced Oct 22, 2025
Open
Open
Open
Open
Open
Open
Open
vmoens added 2 commits October 22, 2025 12:31
@vmoens
Update
ec8b1cd 
[ghstack-poisoned]
@vmoens
Update
8f59fcd 
[ghstack-poisoned]
@github-actions
Copy link

github-actions bot commented Oct 22, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}27$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 85.9278μs 84.2093μs 11.8752 KOps/s 12.2552 KOps/s $\color{#d91a1a}-3.10\%$
test_tensor_to_bytestream_speed[torch.save] 0.1429ms 0.1417ms 7.0560 KOps/s 7.0690 KOps/s $\color{#d91a1a}-0.18\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1208s 0.1205s 8.3021 Ops/s 8.2832 Ops/s $\color{#35bf28}+0.23\%$
test_tensor_to_bytestream_speed[numpy] 2.7565μs 2.7395μs 365.0331 KOps/s 360.7153 KOps/s $\color{#35bf28}+1.20\%$
test_tensor_to_bytestream_speed[safetensors] 42.8890μs 42.6189μs 23.4638 KOps/s 23.7978 KOps/s $\color{#d91a1a}-1.40\%$
test_simple 0.6518s 0.5610s 1.7824 Ops/s 1.7582 Ops/s $\color{#35bf28}+1.38\%$
test_transformed 1.2065s 1.1131s 0.8984 Ops/s 0.8832 Ops/s $\color{#35bf28}+1.71\%$
test_serial 1.6426s 1.6399s 0.6098 Ops/s 0.5918 Ops/s $\color{#35bf28}+3.04\%$
test_parallel 1.1966s 1.1342s 0.8816 Ops/s 0.9174 Ops/s $\color{#d91a1a}-3.89\%$
test_step_mdp_speed[True-True-True-True-True] 0.2201ms 44.9903μs 22.2270 KOps/s 23.0693 KOps/s $\color{#d91a1a}-3.65\%$
test_step_mdp_speed[True-True-True-True-False] 0.4423ms 24.7985μs 40.3250 KOps/s 40.6475 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[True-True-True-False-True] 0.4524ms 25.0163μs 39.9740 KOps/s 40.3836 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[True-True-True-False-False] 46.1610μs 13.7996μs 72.4661 KOps/s 73.4492 KOps/s $\color{#d91a1a}-1.34\%$
test_step_mdp_speed[True-True-False-True-True] 0.4673ms 48.2569μs 20.7224 KOps/s 21.3192 KOps/s $\color{#d91a1a}-2.80\%$
test_step_mdp_speed[True-True-False-True-False] 0.4411ms 27.2772μs 36.6606 KOps/s 36.0846 KOps/s $\color{#35bf28}+1.60\%$
test_step_mdp_speed[True-True-False-False-True] 63.6510μs 27.9157μs 35.8221 KOps/s 36.5005 KOps/s $\color{#d91a1a}-1.86\%$
test_step_mdp_speed[True-True-False-False-False] 0.4351ms 16.3490μs 61.1658 KOps/s 61.1143 KOps/s $\color{#35bf28}+0.08\%$
test_step_mdp_speed[True-False-True-True-True] 0.4698ms 51.0140μs 19.6025 KOps/s 20.0628 KOps/s $\color{#d91a1a}-2.29\%$
test_step_mdp_speed[True-False-True-True-False] 0.4375ms 29.8171μs 33.5378 KOps/s 33.1637 KOps/s $\color{#35bf28}+1.13\%$
test_step_mdp_speed[True-False-True-False-True] 61.4910μs 27.9974μs 35.7176 KOps/s 36.1455 KOps/s $\color{#d91a1a}-1.18\%$
test_step_mdp_speed[True-False-True-False-False] 0.4473ms 16.5149μs 60.5512 KOps/s 60.9444 KOps/s $\color{#d91a1a}-0.65\%$
test_step_mdp_speed[True-False-False-True-True] 0.4634ms 53.3134μs 18.7570 KOps/s 19.2521 KOps/s $\color{#d91a1a}-2.57\%$
test_step_mdp_speed[True-False-False-True-False] 0.4426ms 33.0912μs 30.2195 KOps/s 30.2868 KOps/s $\color{#d91a1a}-0.22\%$
test_step_mdp_speed[True-False-False-False-True] 62.2620μs 30.4918μs 32.7957 KOps/s 33.3636 KOps/s $\color{#d91a1a}-1.70\%$
test_step_mdp_speed[True-False-False-False-False] 0.4434ms 18.7750μs 53.2623 KOps/s 52.5287 KOps/s $\color{#35bf28}+1.40\%$
test_step_mdp_speed[False-True-True-True-True] 0.4613ms 51.2780μs 19.5015 KOps/s 19.9612 KOps/s $\color{#d91a1a}-2.30\%$
test_step_mdp_speed[False-True-True-True-False] 0.4495ms 30.2804μs 33.0247 KOps/s 32.6543 KOps/s $\color{#35bf28}+1.13\%$
test_step_mdp_speed[False-True-True-False-True] 2.3777ms 32.1201μs 31.1331 KOps/s 31.1099 KOps/s $\color{#35bf28}+0.07\%$
test_step_mdp_speed[False-True-True-False-False] 0.4320ms 18.5150μs 54.0104 KOps/s 54.9104 KOps/s $\color{#d91a1a}-1.64\%$
test_step_mdp_speed[False-True-False-True-True] 0.4706ms 53.8517μs 18.5695 KOps/s 19.2361 KOps/s $\color{#d91a1a}-3.47\%$
test_step_mdp_speed[False-True-False-True-False] 0.4392ms 32.7572μs 30.5276 KOps/s 30.2819 KOps/s $\color{#35bf28}+0.81\%$
test_step_mdp_speed[False-True-False-False-True] 69.6320μs 34.4682μs 29.0122 KOps/s 29.2526 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[False-True-False-False-False] 0.4345ms 20.8542μs 47.9519 KOps/s 48.6392 KOps/s $\color{#d91a1a}-1.41\%$
test_step_mdp_speed[False-False-True-True-True] 0.4709ms 56.6625μs 17.6484 KOps/s 18.0316 KOps/s $\color{#d91a1a}-2.13\%$
test_step_mdp_speed[False-False-True-True-False] 0.4543ms 35.9432μs 27.8217 KOps/s 28.0471 KOps/s $\color{#d91a1a}-0.80\%$
test_step_mdp_speed[False-False-True-False-True] 0.1071ms 34.1290μs 29.3006 KOps/s 29.0708 KOps/s $\color{#35bf28}+0.79\%$
test_step_mdp_speed[False-False-True-False-False] 0.4263ms 20.8538μs 47.9528 KOps/s 47.5009 KOps/s $\color{#35bf28}+0.95\%$
test_step_mdp_speed[False-False-False-True-True] 0.4670ms 58.1043μs 17.2104 KOps/s 17.5388 KOps/s $\color{#d91a1a}-1.87\%$
test_step_mdp_speed[False-False-False-True-False] 0.4405ms 38.0077μs 26.3104 KOps/s 26.5350 KOps/s $\color{#d91a1a}-0.85\%$
test_step_mdp_speed[False-False-False-False-True] 71.0510μs 36.4891μs 27.4055 KOps/s 27.5603 KOps/s $\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-False-False-False-False] 0.4351ms 23.5699μs 42.4269 KOps/s 42.7443 KOps/s $\color{#d91a1a}-0.74\%$
test_values[generalized_advantage_estimate-True-True] 10.6441ms 10.3903ms 96.2433 Ops/s 95.7746 Ops/s $\color{#35bf28}+0.49\%$
test_values[vec_generalized_advantage_estimate-True-True] 19.5939ms 17.6329ms 56.7122 Ops/s 88.7867 Ops/s $\textbf{\color{#d91a1a}-36.13\%}$
test_values[td0_return_estimate-False-False] 0.2191ms 0.1315ms 7.6046 KOps/s 7.5517 KOps/s $\color{#35bf28}+0.70\%$
test_values[td1_return_estimate-False-False] 30.2912ms 28.4938ms 35.0953 Ops/s 35.0711 Ops/s $\color{#35bf28}+0.07\%$
test_values[vec_td1_return_estimate-False-False] 18.1645ms 17.5860ms 56.8636 Ops/s 88.7694 Ops/s $\textbf{\color{#d91a1a}-35.94\%}$
test_values[td_lambda_return_estimate-True-False] 44.8531ms 42.2389ms 23.6749 Ops/s 23.5337 Ops/s $\color{#35bf28}+0.60\%$
test_values[vec_td_lambda_return_estimate-True-False] 18.1867ms 17.6307ms 56.7192 Ops/s 89.1146 Ops/s $\textbf{\color{#d91a1a}-36.35\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.4110ms 8.9229ms 112.0706 Ops/s 111.8649 Ops/s $\color{#35bf28}+0.18\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.9086ms 1.5345ms 651.6794 Ops/s 673.6047 Ops/s $\color{#d91a1a}-3.25\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4900ms 0.4294ms 2.3287 KOps/s 2.3958 KOps/s $\color{#d91a1a}-2.80\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 34.9731ms 33.3847ms 29.9539 Ops/s 33.1742 Ops/s $\textbf{\color{#d91a1a}-9.71\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 2.1338ms 1.7334ms 576.8899 Ops/s 576.2638 Ops/s $\color{#35bf28}+0.11\%$
test_dqn_speed[False-None] 6.4501ms 1.4337ms 697.5183 Ops/s 704.0733 Ops/s $\color{#d91a1a}-0.93\%$
test_dqn_speed[False-backward] 1.9861ms 1.9182ms 521.3143 Ops/s 516.7499 Ops/s $\color{#35bf28}+0.88\%$
test_dqn_speed[True-None] 0.9131ms 0.5140ms 1.9456 KOps/s 1.9290 KOps/s $\color{#35bf28}+0.86\%$
test_dqn_speed[True-backward] 1.3870ms 0.9785ms 1.0220 KOps/s 1.0145 KOps/s $\color{#35bf28}+0.73\%$
test_dqn_speed[reduce-overhead-None] 0.9078ms 0.5090ms 1.9648 KOps/s 1.9552 KOps/s $\color{#35bf28}+0.49\%$
test_dqn_speed[reduce-overhead-backward] 0.9984ms 0.9534ms 1.0489 KOps/s 935.5677 Ops/s $\textbf{\color{#35bf28}+12.11\%}$
test_ddpg_speed[False-None] 3.2862ms 2.8647ms 349.0787 Ops/s 345.1991 Ops/s $\color{#35bf28}+1.12\%$
test_ddpg_speed[False-backward] 4.4194ms 4.1203ms 242.7021 Ops/s 242.8164 Ops/s $\color{#d91a1a}-0.05\%$
test_ddpg_speed[True-None] 2.4366ms 1.4127ms 707.8550 Ops/s 694.4907 Ops/s $\color{#35bf28}+1.92\%$
test_ddpg_speed[True-backward] 2.4626ms 2.3754ms 420.9849 Ops/s 374.6035 Ops/s $\textbf{\color{#35bf28}+12.38\%}$
test_ddpg_speed[reduce-overhead-None] 1.7637ms 1.3731ms 728.2911 Ops/s 689.4005 Ops/s $\textbf{\color{#35bf28}+5.64\%}$
test_ddpg_speed[reduce-overhead-backward] 2.4166ms 2.3486ms 425.7808 Ops/s 354.2184 Ops/s $\textbf{\color{#35bf28}+20.20\%}$
test_sac_speed[False-None] 8.3246ms 7.8033ms 128.1516 Ops/s 126.4081 Ops/s $\color{#35bf28}+1.38\%$
test_sac_speed[False-backward] 11.4410ms 11.0987ms 90.1006 Ops/s 89.1579 Ops/s $\color{#35bf28}+1.06\%$
test_sac_speed[True-None] 2.5351ms 2.1187ms 471.9883 Ops/s 458.5940 Ops/s $\color{#35bf28}+2.92\%$
test_sac_speed[True-backward] 4.4209ms 4.0439ms 247.2878 Ops/s 212.6979 Ops/s $\textbf{\color{#35bf28}+16.26\%}$
test_sac_speed[reduce-overhead-None] 2.4891ms 2.1144ms 472.9474 Ops/s 457.0636 Ops/s $\color{#35bf28}+3.48\%$
test_sac_speed[reduce-overhead-backward] 4.1570ms 4.0438ms 247.2905 Ops/s 221.8517 Ops/s $\textbf{\color{#35bf28}+11.47\%}$
test_redq_speed[False-None] 11.0674ms 10.2984ms 97.1022 Ops/s 94.2552 Ops/s $\color{#35bf28}+3.02\%$
test_redq_speed[False-backward] 24.3109ms 18.3555ms 54.4797 Ops/s 54.7172 Ops/s $\color{#d91a1a}-0.43\%$
test_redq_speed[True-None] 4.7563ms 4.4543ms 224.5029 Ops/s 226.2867 Ops/s $\color{#d91a1a}-0.79\%$
test_redq_speed[True-backward] 10.3587ms 10.0197ms 99.8034 Ops/s 99.7466 Ops/s $\color{#35bf28}+0.06\%$
test_redq_speed[reduce-overhead-None] 4.9887ms 4.4631ms 224.0597 Ops/s 214.2069 Ops/s $\color{#35bf28}+4.60\%$
test_redq_speed[reduce-overhead-backward] 10.8414ms 10.2388ms 97.6675 Ops/s 97.2051 Ops/s $\color{#35bf28}+0.48\%$
test_redq_deprec_speed[False-None] 11.3063ms 10.8704ms 91.9929 Ops/s 91.8009 Ops/s $\color{#35bf28}+0.21\%$
test_redq_deprec_speed[False-backward] 16.1859ms 15.6622ms 63.8481 Ops/s 63.8471 Ops/s $+0.00\%$
test_redq_deprec_speed[True-None] 4.0330ms 3.6531ms 273.7368 Ops/s 264.0633 Ops/s $\color{#35bf28}+3.66\%$
test_redq_deprec_speed[True-backward] 7.9169ms 7.7019ms 129.8377 Ops/s 124.2888 Ops/s $\color{#35bf28}+4.46\%$
test_redq_deprec_speed[reduce-overhead-None] 4.0331ms 3.6408ms 274.6624 Ops/s 275.2745 Ops/s $\color{#d91a1a}-0.22\%$
test_redq_deprec_speed[reduce-overhead-backward] 8.2588ms 7.7203ms 129.5279 Ops/s 135.0067 Ops/s $\color{#d91a1a}-4.06\%$
test_td3_speed[False-None] 8.0043ms 7.8609ms 127.2122 Ops/s 126.4014 Ops/s $\color{#35bf28}+0.64\%$
test_td3_speed[False-backward] 11.4123ms 10.7909ms 92.6707 Ops/s 91.9058 Ops/s $\color{#35bf28}+0.83\%$
test_td3_speed[True-None] 1.8776ms 1.8005ms 555.4092 Ops/s 551.8576 Ops/s $\color{#35bf28}+0.64\%$
test_td3_speed[True-backward] 3.7425ms 3.6278ms 275.6503 Ops/s 252.3004 Ops/s $\textbf{\color{#35bf28}+9.25\%}$
test_td3_speed[reduce-overhead-None] 1.8078ms 1.7740ms 563.7069 Ops/s 558.4164 Ops/s $\color{#35bf28}+0.95\%$
test_td3_speed[reduce-overhead-backward] 3.7733ms 3.6603ms 273.2022 Ops/s 266.9463 Ops/s $\color{#35bf28}+2.34\%$
test_cql_speed[False-None] 29.4636ms 26.0529ms 38.3835 Ops/s 38.5289 Ops/s $\color{#d91a1a}-0.38\%$
test_cql_speed[False-backward] 38.4938ms 35.6098ms 28.0822 Ops/s 27.6246 Ops/s $\color{#35bf28}+1.66\%$
test_cql_speed[True-None] 12.8105ms 12.4137ms 80.5560 Ops/s 81.0816 Ops/s $\color{#d91a1a}-0.65\%$
test_cql_speed[True-backward] 18.9153ms 18.4752ms 54.1267 Ops/s 54.5232 Ops/s $\color{#d91a1a}-0.73\%$
test_cql_speed[reduce-overhead-None] 13.0857ms 12.6300ms 79.1768 Ops/s 80.7936 Ops/s $\color{#d91a1a}-2.00\%$
test_cql_speed[reduce-overhead-backward] 19.0667ms 18.5888ms 53.7958 Ops/s 56.0924 Ops/s $\color{#d91a1a}-4.09\%$
test_a2c_speed[False-None] 5.7714ms 5.3692ms 186.2467 Ops/s 184.3329 Ops/s $\color{#35bf28}+1.04\%$
test_a2c_speed[False-backward] 12.4367ms 11.8000ms 84.7459 Ops/s 83.4273 Ops/s $\color{#35bf28}+1.58\%$
test_a2c_speed[True-None] 4.0992ms 3.7198ms 268.8310 Ops/s 267.6084 Ops/s $\color{#35bf28}+0.46\%$
test_a2c_speed[True-backward] 8.8893ms 8.6686ms 115.3586 Ops/s 108.5231 Ops/s $\textbf{\color{#35bf28}+6.30\%}$
test_a2c_speed[reduce-overhead-None] 3.8494ms 3.7293ms 268.1466 Ops/s 265.4537 Ops/s $\color{#35bf28}+1.01\%$
test_a2c_speed[reduce-overhead-backward] 9.2433ms 8.8886ms 112.5031 Ops/s 106.2224 Ops/s $\textbf{\color{#35bf28}+5.91\%}$
test_ppo_speed[False-None] 6.1751ms 5.9465ms 168.1647 Ops/s 171.0024 Ops/s $\color{#d91a1a}-1.66\%$
test_ppo_speed[False-backward] 13.0555ms 12.7458ms 78.4570 Ops/s 79.3443 Ops/s $\color{#d91a1a}-1.12\%$
test_ppo_speed[True-None] 3.8765ms 3.6833ms 271.4962 Ops/s 273.3994 Ops/s $\color{#d91a1a}-0.70\%$
test_ppo_speed[True-backward] 8.9636ms 8.6218ms 115.9855 Ops/s 116.1128 Ops/s $\color{#d91a1a}-0.11\%$
test_ppo_speed[reduce-overhead-None] 3.7045ms 3.6060ms 277.3171 Ops/s 273.6766 Ops/s $\color{#35bf28}+1.33\%$
test_ppo_speed[reduce-overhead-backward] 8.9992ms 8.8023ms 113.6069 Ops/s 99.8567 Ops/s $\textbf{\color{#35bf28}+13.77\%}$
test_reinforce_speed[False-None] 4.8131ms 4.5621ms 219.1982 Ops/s 211.2628 Ops/s $\color{#35bf28}+3.76\%$
test_reinforce_speed[False-backward] 7.8851ms 7.4531ms 134.1725 Ops/s 133.0125 Ops/s $\color{#35bf28}+0.87\%$
test_reinforce_speed[True-None] 3.3001ms 2.8648ms 349.0624 Ops/s 336.7637 Ops/s $\color{#35bf28}+3.65\%$
test_reinforce_speed[True-backward] 8.0962ms 7.8247ms 127.8007 Ops/s 109.0193 Ops/s $\textbf{\color{#35bf28}+17.23\%}$
test_reinforce_speed[reduce-overhead-None] 3.2974ms 2.8589ms 349.7890 Ops/s 341.7810 Ops/s $\color{#35bf28}+2.34\%$
test_reinforce_speed[reduce-overhead-backward] 8.4670ms 7.9355ms 126.0161 Ops/s 117.8939 Ops/s $\textbf{\color{#35bf28}+6.89\%}$
test_iql_speed[False-None] 25.1938ms 20.1869ms 49.5370 Ops/s 50.0976 Ops/s $\color{#d91a1a}-1.12\%$
test_iql_speed[False-backward] 36.3591ms 30.8320ms 32.4339 Ops/s 32.4682 Ops/s $\color{#d91a1a}-0.11\%$
test_iql_speed[True-None] 8.8884ms 8.5829ms 116.5107 Ops/s 108.8662 Ops/s $\textbf{\color{#35bf28}+7.02\%}$
test_iql_speed[True-backward] 17.5928ms 16.9744ms 58.9124 Ops/s 58.6681 Ops/s $\color{#35bf28}+0.42\%$
test_iql_speed[reduce-overhead-None] 9.0847ms 8.6552ms 115.5376 Ops/s 113.7634 Ops/s $\color{#35bf28}+1.56\%$
test_iql_speed[reduce-overhead-backward] 17.6492ms 17.3394ms 57.6721 Ops/s 57.4972 Ops/s $\color{#35bf28}+0.30\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.3305ms 5.8051ms 172.2618 Ops/s 172.5306 Ops/s $\color{#d91a1a}-0.16\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7007ms 0.2760ms 3.6234 KOps/s 3.0649 KOps/s $\textbf{\color{#35bf28}+18.22\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5561ms 0.2560ms 3.9070 KOps/s 3.0197 KOps/s $\textbf{\color{#35bf28}+29.38\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.7695ms 5.5341ms 180.6973 Ops/s 181.1516 Ops/s $\color{#d91a1a}-0.25\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.9378ms 0.2705ms 3.6969 KOps/s 3.0699 KOps/s $\textbf{\color{#35bf28}+20.43\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4652ms 0.2505ms 3.9919 KOps/s 3.5311 KOps/s $\textbf{\color{#35bf28}+13.05\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6793ms 1.2562ms 796.0792 Ops/s 710.9420 Ops/s $\textbf{\color{#35bf28}+11.98\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.3668ms 1.1702ms 854.5555 Ops/s 759.9827 Ops/s $\textbf{\color{#35bf28}+12.44\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.5681ms 5.8232ms 171.7276 Ops/s 174.7434 Ops/s $\color{#d91a1a}-1.73\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.8175ms 0.4221ms 2.3689 KOps/s 2.0570 KOps/s $\textbf{\color{#35bf28}+15.17\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7927ms 0.4039ms 2.4759 KOps/s 2.1768 KOps/s $\textbf{\color{#35bf28}+13.74\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.7040ms 5.5542ms 180.0440 Ops/s 180.5344 Ops/s $\color{#d91a1a}-0.27\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9470ms 0.2730ms 3.6635 KOps/s 781.2939 Ops/s $\textbf{\color{#35bf28}+368.91\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6796ms 0.3171ms 3.1534 KOps/s 3.8488 KOps/s $\textbf{\color{#d91a1a}-18.07\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.7320ms 5.5032ms 181.7110 Ops/s 178.1675 Ops/s $\color{#35bf28}+1.99\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.9001ms 0.3222ms 3.1037 KOps/s 2.9441 KOps/s $\textbf{\color{#35bf28}+5.42\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5959ms 0.3681ms 2.7163 KOps/s 3.0049 KOps/s $\textbf{\color{#d91a1a}-9.60\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.3458ms 5.7079ms 175.1953 Ops/s 172.5669 Ops/s $\color{#35bf28}+1.52\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.5327s 1.1847ms 844.1024 Ops/s 2.1133 KOps/s $\textbf{\color{#d91a1a}-60.06\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6147ms 0.4052ms 2.4680 KOps/s 2.3470 KOps/s $\textbf{\color{#35bf28}+5.16\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.5162ms 4.9703ms 201.1951 Ops/s 195.4542 Ops/s $\color{#35bf28}+2.94\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 9.9331ms 1.9841ms 503.9990 Ops/s 443.5018 Ops/s $\textbf{\color{#35bf28}+13.64\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.1786ms 1.1285ms 886.0960 Ops/s 860.3689 Ops/s $\color{#35bf28}+2.99\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 6.5767ms 5.0513ms 197.9688 Ops/s 56.1745 Ops/s $\textbf{\color{#35bf28}+252.42\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 9.8583ms 2.0381ms 490.6462 Ops/s 481.4559 Ops/s $\color{#35bf28}+1.91\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 5.9216ms 1.1582ms 863.4279 Ops/s 894.7645 Ops/s $\color{#d91a1a}-3.50\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.4863s 14.8430ms 67.3718 Ops/s 185.2507 Ops/s $\textbf{\color{#d91a1a}-63.63\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 4.0357ms 1.9126ms 522.8600 Ops/s 458.7757 Ops/s $\textbf{\color{#35bf28}+13.97\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.2013ms 1.0110ms 989.1274 Ops/s 991.4178 Ops/s $\color{#d91a1a}-0.23\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 34.7289ms 32.7233ms 30.5592 Ops/s 29.7750 Ops/s $\color{#35bf28}+2.63\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 18.5733ms 17.2028ms 58.1302 Ops/s 57.4673 Ops/s $\color{#35bf28}+1.15\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 36.0344ms 33.7389ms 29.6394 Ops/s 28.8835 Ops/s $\color{#35bf28}+2.62\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 18.8299ms 17.3751ms 57.5535 Ops/s 56.2409 Ops/s $\color{#35bf28}+2.33\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 37.3948ms 35.3511ms 28.2877 Ops/s 27.8738 Ops/s $\color{#35bf28}+1.48\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.0420ms 18.8382ms 53.0837 Ops/s 52.4284 Ops/s $\color{#35bf28}+1.25\%$

vmoens added 5 commits October 22, 2025 13:29
@vmoens
Update
44807c6 
[ghstack-poisoned]
@vmoens
Update
8ba6488 
[ghstack-poisoned]
@vmoens
Update
d24c52b 
[ghstack-poisoned]
@vmoens
Update
5930cb3 
[ghstack-poisoned]
@vmoens
Update
847f875 
[ghstack-poisoned]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. llm/ci

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens