Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[Feature] Documentation #3192

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 30 commits into
base: gh/vmoens/155/base
Choose a base branch
from
Open

[Feature] Documentation #3192

wants to merge 30 commits into from
+257 −40

Conversation

vmoens
Copy link
Collaborator

@vmoens vmoens commented Oct 14, 2025 •
edited
Loading

@vmoens
Update
e9756e2 
[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Oct 14, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3192

Note: Links to docs will display an error until the docs builds have been completed.

❌ 12 New Failures, 1 Unrelated Failure

As of commit b6bb797 with merge base 963fdd4 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

vmoens added a commit that referenced this pull request Oct 14, 2025
@vmoens
[Feature] Documentation
1776f5c 
ghstack-source-id: 82ba745
Pull-Request: #3192
This was referenced Oct 14, 2025
Merged
Merged
Merged
Merged
Merged
Open
Open
Open
Open
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 14, 2025
@vmoens
Update
0915502 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 16, 2025
@vmoens
[Feature] Documentation
39e1f41 
ghstack-source-id: 9bec4ff
Pull-Request: #3192
@vmoens
Update
c69220c 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
182f9c2 
ghstack-source-id: d0d0cf5
Pull-Request: #3192
@vmoens
Update
f329065 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
352ef18 
ghstack-source-id: 6cb0086
Pull-Request: #3192
@vmoens
Update
b6640d4 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
4a27b91 
ghstack-source-id: f17f26c
Pull-Request: #3192
@vmoens
Update
dced4a7 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
69220a8 
ghstack-source-id: 6683361
Pull-Request: #3192
@vmoens
Update
49733a8 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
107ab58 
ghstack-source-id: bb9f0e2
Pull-Request: #3192
@vmoens
Update
e4ef881 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Oct 18, 2025
Open
vmoens added 3 commits October 18, 2025 16:15
@vmoens
Update
ba7d03f 
[ghstack-poisoned]
@vmoens
Update
936b651 
[ghstack-poisoned]
@vmoens
Update
c4b7847 
[ghstack-poisoned]
vmoens added 2 commits October 19, 2025 17:03
@vmoens
Update
60f0310 
[ghstack-poisoned]
@vmoens
Update
8dfc00b 
[ghstack-poisoned]
@vmoens vmoens added the documentation Improvements or additions to documentation label Oct 20, 2025
@vmoens
Update
69be737 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Oct 20, 2025
Merged
@vmoens
Update
cd8aed5 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Oct 20, 2025
Merged
@vmoens
Update
88e5ca9 
[ghstack-poisoned]
@github-actions
Copy link

github-actions bot commented Oct 20, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}15$. Worsened: $\large\color{#d91a1a}17$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 83.9775μs 82.3775μs 12.1392 KOps/s 11.9857 KOps/s $\color{#35bf28}+1.28\%$
test_tensor_to_bytestream_speed[torch.save] 0.1416ms 0.1412ms 7.0800 KOps/s 6.9744 KOps/s $\color{#35bf28}+1.51\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1243s 0.1240s 8.0645 Ops/s 7.9345 Ops/s $\color{#35bf28}+1.64\%$
test_tensor_to_bytestream_speed[numpy] 2.8938μs 2.8837μs 346.7753 KOps/s 348.8242 KOps/s $\color{#d91a1a}-0.59\%$
test_tensor_to_bytestream_speed[safetensors] 43.2227μs 42.8667μs 23.3281 KOps/s 22.5599 KOps/s $\color{#35bf28}+3.40\%$
test_simple 0.5599s 0.5588s 1.7895 Ops/s 1.7107 Ops/s $\color{#35bf28}+4.60\%$
test_transformed 1.1606s 1.1371s 0.8795 Ops/s 0.8640 Ops/s $\color{#35bf28}+1.79\%$
test_serial 1.7528s 1.7063s 0.5861 Ops/s 0.5825 Ops/s $\color{#35bf28}+0.61\%$
test_parallel 1.1756s 1.1069s 0.9035 Ops/s 0.9144 Ops/s $\color{#d91a1a}-1.20\%$
test_step_mdp_speed[True-True-True-True-True] 0.1530ms 44.5448μs 22.4493 KOps/s 22.7268 KOps/s $\color{#d91a1a}-1.22\%$
test_step_mdp_speed[True-True-True-True-False] 58.1910μs 25.3598μs 39.4325 KOps/s 40.0893 KOps/s $\color{#d91a1a}-1.64\%$
test_step_mdp_speed[True-True-True-False-True] 54.8110μs 25.7060μs 38.9015 KOps/s 39.8162 KOps/s $\color{#d91a1a}-2.30\%$
test_step_mdp_speed[True-True-True-False-False] 39.1510μs 14.0726μs 71.0599 KOps/s 72.3387 KOps/s $\color{#d91a1a}-1.77\%$
test_step_mdp_speed[True-True-False-True-True] 87.8710μs 47.5400μs 21.0349 KOps/s 21.0475 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[True-True-False-True-False] 89.9510μs 27.7346μs 36.0560 KOps/s 36.4066 KOps/s $\color{#d91a1a}-0.96\%$
test_step_mdp_speed[True-True-False-False-True] 85.7610μs 26.8394μs 37.2587 KOps/s 35.7270 KOps/s $\color{#35bf28}+4.29\%$
test_step_mdp_speed[True-True-False-False-False] 47.0400μs 16.5254μs 60.5128 KOps/s 61.0586 KOps/s $\color{#d91a1a}-0.89\%$
test_step_mdp_speed[True-False-True-True-True] 88.5010μs 50.9690μs 19.6198 KOps/s 19.8963 KOps/s $\color{#d91a1a}-1.39\%$
test_step_mdp_speed[True-False-True-True-False] 65.5210μs 30.8998μs 32.3627 KOps/s 32.9589 KOps/s $\color{#d91a1a}-1.81\%$
test_step_mdp_speed[True-False-True-False-True] 61.1810μs 27.8200μs 35.9453 KOps/s 35.2115 KOps/s $\color{#35bf28}+2.08\%$
test_step_mdp_speed[True-False-True-False-False] 36.2300μs 16.7179μs 59.8161 KOps/s 60.5629 KOps/s $\color{#d91a1a}-1.23\%$
test_step_mdp_speed[True-False-False-True-True] 0.1165ms 53.6239μs 18.6484 KOps/s 18.8167 KOps/s $\color{#d91a1a}-0.89\%$
test_step_mdp_speed[True-False-False-True-False] 63.2810μs 33.2923μs 30.0370 KOps/s 30.0865 KOps/s $\color{#d91a1a}-0.16\%$
test_step_mdp_speed[True-False-False-False-True] 63.6810μs 30.6276μs 32.6503 KOps/s 32.6845 KOps/s $\color{#d91a1a}-0.10\%$
test_step_mdp_speed[True-False-False-False-False] 49.8700μs 19.1206μs 52.2996 KOps/s 52.3982 KOps/s $\color{#d91a1a}-0.19\%$
test_step_mdp_speed[False-True-True-True-True] 79.1210μs 50.4017μs 19.8406 KOps/s 19.6740 KOps/s $\color{#35bf28}+0.85\%$
test_step_mdp_speed[False-True-True-True-False] 60.9400μs 30.5555μs 32.7273 KOps/s 32.7617 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[False-True-True-False-True] 2.4941ms 32.4407μs 30.8255 KOps/s 31.1408 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[False-True-True-False-False] 48.3910μs 18.5940μs 53.7808 KOps/s 54.5891 KOps/s $\color{#d91a1a}-1.48\%$
test_step_mdp_speed[False-True-False-True-True] 84.7310μs 53.2122μs 18.7927 KOps/s 18.9265 KOps/s $\color{#d91a1a}-0.71\%$
test_step_mdp_speed[False-True-False-True-False] 64.7810μs 33.1107μs 30.2017 KOps/s 30.0190 KOps/s $\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-True-False-False-True] 64.7710μs 33.9785μs 29.4303 KOps/s 28.8388 KOps/s $\color{#35bf28}+2.05\%$
test_step_mdp_speed[False-True-False-False-False] 53.5900μs 20.7189μs 48.2651 KOps/s 47.3968 KOps/s $\color{#35bf28}+1.83\%$
test_step_mdp_speed[False-False-True-True-True] 91.2710μs 55.1073μs 18.1464 KOps/s 17.8525 KOps/s $\color{#35bf28}+1.65\%$
test_step_mdp_speed[False-False-True-True-False] 61.3210μs 35.7631μs 27.9617 KOps/s 27.8740 KOps/s $\color{#35bf28}+0.31\%$
test_step_mdp_speed[False-False-True-False-True] 66.2400μs 34.0825μs 29.3406 KOps/s 28.6509 KOps/s $\color{#35bf28}+2.41\%$
test_step_mdp_speed[False-False-True-False-False] 54.3910μs 21.0566μs 47.4910 KOps/s 48.0700 KOps/s $\color{#d91a1a}-1.20\%$
test_step_mdp_speed[False-False-False-True-True] 87.9510μs 58.0204μs 17.2353 KOps/s 17.0133 KOps/s $\color{#35bf28}+1.31\%$
test_step_mdp_speed[False-False-False-True-False] 77.7110μs 38.1133μs 26.2375 KOps/s 25.8824 KOps/s $\color{#35bf28}+1.37\%$
test_step_mdp_speed[False-False-False-False-True] 65.6110μs 35.7841μs 27.9454 KOps/s 27.2997 KOps/s $\color{#35bf28}+2.37\%$
test_step_mdp_speed[False-False-False-False-False] 54.7700μs 23.1897μs 43.1226 KOps/s 42.8908 KOps/s $\color{#35bf28}+0.54\%$
test_values[generalized_advantage_estimate-True-True] 11.2651ms 10.4145ms 96.0203 Ops/s 93.3950 Ops/s $\color{#35bf28}+2.81\%$
test_values[vec_generalized_advantage_estimate-True-True] 19.9379ms 17.4734ms 57.2297 Ops/s 90.0617 Ops/s $\textbf{\color{#d91a1a}-36.45\%}$
test_values[td0_return_estimate-False-False] 0.2161ms 0.1343ms 7.4450 KOps/s 7.7374 KOps/s $\color{#d91a1a}-3.78\%$
test_values[td1_return_estimate-False-False] 29.3396ms 28.9018ms 34.5999 Ops/s 34.4200 Ops/s $\color{#35bf28}+0.52\%$
test_values[vec_td1_return_estimate-False-False] 21.2502ms 17.6132ms 56.7757 Ops/s 89.5506 Ops/s $\textbf{\color{#d91a1a}-36.60\%}$
test_values[td_lambda_return_estimate-True-False] 46.7942ms 43.3147ms 23.0869 Ops/s 22.8908 Ops/s $\color{#35bf28}+0.86\%$
test_values[vec_td_lambda_return_estimate-True-False] 20.4797ms 17.6272ms 56.7304 Ops/s 89.9777 Ops/s $\textbf{\color{#d91a1a}-36.95\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.3139ms 9.2225ms 108.4306 Ops/s 107.7526 Ops/s $\color{#35bf28}+0.63\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7575ms 1.5031ms 665.2940 Ops/s 653.4531 Ops/s $\color{#35bf28}+1.81\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4586ms 0.4228ms 2.3652 KOps/s 2.3899 KOps/s $\color{#d91a1a}-1.03\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 34.9080ms 34.1946ms 29.2444 Ops/s 33.5175 Ops/s $\textbf{\color{#d91a1a}-12.75\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.8649ms 1.7136ms 583.5506 Ops/s 578.8471 Ops/s $\color{#35bf28}+0.81\%$
test_dqn_speed[False-None] 6.6206ms 1.4470ms 691.0774 Ops/s 689.6371 Ops/s $\color{#35bf28}+0.21\%$
test_dqn_speed[False-backward] 1.9932ms 1.9443ms 514.3249 Ops/s 513.2688 Ops/s $\color{#35bf28}+0.21\%$
test_dqn_speed[True-None] 0.9082ms 0.5284ms 1.8924 KOps/s 1.9023 KOps/s $\color{#d91a1a}-0.52\%$
test_dqn_speed[True-backward] 1.0100ms 0.9743ms 1.0264 KOps/s 916.3596 Ops/s $\textbf{\color{#35bf28}+12.01\%}$
test_dqn_speed[reduce-overhead-None] 0.5972ms 0.5163ms 1.9367 KOps/s 1.8851 KOps/s $\color{#35bf28}+2.74\%$
test_dqn_speed[reduce-overhead-backward] 1.0068ms 0.9616ms 1.0400 KOps/s 867.8858 Ops/s $\textbf{\color{#35bf28}+19.83\%}$
test_ddpg_speed[False-None] 3.2829ms 2.9306ms 341.2254 Ops/s 334.1939 Ops/s $\color{#35bf28}+2.10\%$
test_ddpg_speed[False-backward] 4.5626ms 4.1738ms 239.5890 Ops/s 243.1356 Ops/s $\color{#d91a1a}-1.46\%$
test_ddpg_speed[True-None] 1.4557ms 1.3896ms 719.6162 Ops/s 702.5627 Ops/s $\color{#35bf28}+2.43\%$
test_ddpg_speed[True-backward] 2.4313ms 2.3649ms 422.8438 Ops/s 416.2862 Ops/s $\color{#35bf28}+1.58\%$
test_ddpg_speed[reduce-overhead-None] 1.7593ms 1.3793ms 725.0134 Ops/s 725.4864 Ops/s $\color{#d91a1a}-0.07\%$
test_ddpg_speed[reduce-overhead-backward] 2.4410ms 2.3708ms 421.7899 Ops/s 403.0952 Ops/s $\color{#35bf28}+4.64\%$
test_sac_speed[False-None] 10.8551ms 8.2116ms 121.7795 Ops/s 125.4984 Ops/s $\color{#d91a1a}-2.96\%$
test_sac_speed[False-backward] 11.8184ms 11.2985ms 88.5077 Ops/s 88.7862 Ops/s $\color{#d91a1a}-0.31\%$
test_sac_speed[True-None] 2.4045ms 2.1044ms 475.1865 Ops/s 474.4117 Ops/s $\color{#35bf28}+0.16\%$
test_sac_speed[True-backward] 4.1347ms 4.0275ms 248.2923 Ops/s 217.6602 Ops/s $\textbf{\color{#35bf28}+14.07\%}$
test_sac_speed[reduce-overhead-None] 2.4666ms 2.0927ms 477.8484 Ops/s 460.7089 Ops/s $\color{#35bf28}+3.72\%$
test_sac_speed[reduce-overhead-backward] 4.1334ms 4.0428ms 247.3555 Ops/s 230.0694 Ops/s $\textbf{\color{#35bf28}+7.51\%}$
test_redq_speed[False-None] 10.8624ms 10.3892ms 96.2535 Ops/s 97.2712 Ops/s $\color{#d91a1a}-1.05\%$
test_redq_speed[False-backward] 22.6592ms 18.3161ms 54.5968 Ops/s 56.7102 Ops/s $\color{#d91a1a}-3.73\%$
test_redq_speed[True-None] 4.6751ms 4.2864ms 233.2967 Ops/s 233.8142 Ops/s $\color{#d91a1a}-0.22\%$
test_redq_speed[True-backward] 10.1624ms 9.8308ms 101.7211 Ops/s 104.7832 Ops/s $\color{#d91a1a}-2.92\%$
test_redq_speed[reduce-overhead-None] 4.7885ms 4.3017ms 232.4667 Ops/s 211.6022 Ops/s $\textbf{\color{#35bf28}+9.86\%}$
test_redq_speed[reduce-overhead-backward] 10.1402ms 9.8975ms 101.0354 Ops/s 101.7912 Ops/s $\color{#d91a1a}-0.74\%$
test_redq_deprec_speed[False-None] 11.4424ms 11.0414ms 90.5681 Ops/s 90.3102 Ops/s $\color{#35bf28}+0.29\%$
test_redq_deprec_speed[False-backward] 16.5931ms 15.9528ms 62.6851 Ops/s 62.8942 Ops/s $\color{#d91a1a}-0.33\%$
test_redq_deprec_speed[True-None] 3.9832ms 3.5619ms 280.7472 Ops/s 278.8651 Ops/s $\color{#35bf28}+0.67\%$
test_redq_deprec_speed[True-backward] 7.8202ms 7.5268ms 132.8584 Ops/s 131.4163 Ops/s $\color{#35bf28}+1.10\%$
test_redq_deprec_speed[reduce-overhead-None] 3.9231ms 3.5626ms 280.6926 Ops/s 289.8829 Ops/s $\color{#d91a1a}-3.17\%$
test_redq_deprec_speed[reduce-overhead-backward] 8.0155ms 7.5560ms 132.3453 Ops/s 132.1029 Ops/s $\color{#35bf28}+0.18\%$
test_td3_speed[False-None] 8.2192ms 8.0432ms 124.3290 Ops/s 124.7076 Ops/s $\color{#d91a1a}-0.30\%$
test_td3_speed[False-backward] 11.6096ms 10.9308ms 91.4847 Ops/s 91.5789 Ops/s $\color{#d91a1a}-0.10\%$
test_td3_speed[True-None] 1.8073ms 1.7782ms 562.3766 Ops/s 562.2368 Ops/s $\color{#35bf28}+0.02\%$
test_td3_speed[True-backward] 3.8775ms 3.6442ms 274.4068 Ops/s 217.4552 Ops/s $\textbf{\color{#35bf28}+26.19\%}$
test_td3_speed[reduce-overhead-None] 1.7828ms 1.7451ms 573.0339 Ops/s 568.6150 Ops/s $\color{#35bf28}+0.78\%$
test_td3_speed[reduce-overhead-backward] 3.7251ms 3.6384ms 274.8494 Ops/s 264.7857 Ops/s $\color{#35bf28}+3.80\%$
test_cql_speed[False-None] 36.8814ms 26.7349ms 37.4042 Ops/s 38.4874 Ops/s $\color{#d91a1a}-2.81\%$
test_cql_speed[False-backward] 38.7221ms 35.4408ms 28.2161 Ops/s 28.5961 Ops/s $\color{#d91a1a}-1.33\%$
test_cql_speed[True-None] 13.1302ms 12.3341ms 81.0762 Ops/s 81.7329 Ops/s $\color{#d91a1a}-0.80\%$
test_cql_speed[True-backward] 19.0266ms 18.4664ms 54.1523 Ops/s 56.1919 Ops/s $\color{#d91a1a}-3.63\%$
test_cql_speed[reduce-overhead-None] 12.6933ms 12.3938ms 80.6852 Ops/s 81.6425 Ops/s $\color{#d91a1a}-1.17\%$
test_cql_speed[reduce-overhead-backward] 18.9852ms 18.4867ms 54.0929 Ops/s 56.2263 Ops/s $\color{#d91a1a}-3.79\%$
test_a2c_speed[False-None] 5.7680ms 5.4459ms 183.6257 Ops/s 185.8053 Ops/s $\color{#d91a1a}-1.17\%$
test_a2c_speed[False-backward] 12.1667ms 11.7975ms 84.7634 Ops/s 85.9255 Ops/s $\color{#d91a1a}-1.35\%$
test_a2c_speed[True-None] 4.1016ms 3.6900ms 271.0032 Ops/s 265.6478 Ops/s $\color{#35bf28}+2.02\%$
test_a2c_speed[True-backward] 8.8684ms 8.6742ms 115.2844 Ops/s 110.5429 Ops/s $\color{#35bf28}+4.29\%$
test_a2c_speed[reduce-overhead-None] 4.0426ms 3.6925ms 270.8213 Ops/s 292.2413 Ops/s $\textbf{\color{#d91a1a}-7.33\%}$
test_a2c_speed[reduce-overhead-backward] 8.9551ms 8.7527ms 114.2502 Ops/s 114.7171 Ops/s $\color{#d91a1a}-0.41\%$
test_ppo_speed[False-None] 6.4182ms 5.9918ms 166.8959 Ops/s 178.2059 Ops/s $\textbf{\color{#d91a1a}-6.35\%}$
test_ppo_speed[False-backward] 12.9896ms 12.5387ms 79.7532 Ops/s 80.7674 Ops/s $\color{#d91a1a}-1.26\%$
test_ppo_speed[True-None] 4.0094ms 3.6577ms 273.3943 Ops/s 293.8075 Ops/s $\textbf{\color{#d91a1a}-6.95\%}$
test_ppo_speed[True-backward] 8.7286ms 8.4969ms 117.6901 Ops/s 122.1883 Ops/s $\color{#d91a1a}-3.68\%$
test_ppo_speed[reduce-overhead-None] 4.0231ms 3.6220ms 276.0904 Ops/s 295.4052 Ops/s $\textbf{\color{#d91a1a}-6.54\%}$
test_ppo_speed[reduce-overhead-backward] 9.0481ms 8.7751ms 113.9585 Ops/s 119.1164 Ops/s $\color{#d91a1a}-4.33\%$
test_reinforce_speed[False-None] 4.9025ms 4.6283ms 216.0640 Ops/s 231.7731 Ops/s $\textbf{\color{#d91a1a}-6.78\%}$
test_reinforce_speed[False-backward] 7.8323ms 7.4408ms 134.3937 Ops/s 138.5792 Ops/s $\color{#d91a1a}-3.02\%$
test_reinforce_speed[True-None] 3.2369ms 2.8494ms 350.9528 Ops/s 366.1250 Ops/s $\color{#d91a1a}-4.14\%$
test_reinforce_speed[True-backward] 8.1795ms 7.6836ms 130.1481 Ops/s 136.0637 Ops/s $\color{#d91a1a}-4.35\%$
test_reinforce_speed[reduce-overhead-None] 3.3131ms 2.8328ms 353.0110 Ops/s 379.4660 Ops/s $\textbf{\color{#d91a1a}-6.97\%}$
test_reinforce_speed[reduce-overhead-backward] 8.1233ms 7.8943ms 126.6731 Ops/s 131.9482 Ops/s $\color{#d91a1a}-4.00\%$
test_iql_speed[False-None] 24.8701ms 20.3034ms 49.2528 Ops/s 50.3969 Ops/s $\color{#d91a1a}-2.27\%$
test_iql_speed[False-backward] 31.0457ms 30.3744ms 32.9225 Ops/s 33.4928 Ops/s $\color{#d91a1a}-1.70\%$
test_iql_speed[True-None] 8.8747ms 8.4284ms 118.6460 Ops/s 127.3103 Ops/s $\textbf{\color{#d91a1a}-6.81\%}$
test_iql_speed[True-backward] 16.9632ms 16.7012ms 59.8761 Ops/s 64.6551 Ops/s $\textbf{\color{#d91a1a}-7.39\%}$
test_iql_speed[reduce-overhead-None] 8.9069ms 8.4933ms 117.7404 Ops/s 123.2610 Ops/s $\color{#d91a1a}-4.48\%$
test_iql_speed[reduce-overhead-backward] 17.6433ms 17.0724ms 58.5741 Ops/s 61.3645 Ops/s $\color{#d91a1a}-4.55\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.7080ms 6.0825ms 164.4067 Ops/s 164.7564 Ops/s $\color{#d91a1a}-0.21\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6089ms 0.3033ms 3.2972 KOps/s 3.3318 KOps/s $\color{#d91a1a}-1.04\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6847ms 0.3038ms 3.2915 KOps/s 3.8254 KOps/s $\textbf{\color{#d91a1a}-13.96\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0771ms 5.8586ms 170.6887 Ops/s 173.4730 Ops/s $\color{#d91a1a}-1.61\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1106ms 0.3299ms 3.0309 KOps/s 2.7644 KOps/s $\textbf{\color{#35bf28}+9.64\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6392ms 0.3204ms 3.1215 KOps/s 2.8364 KOps/s $\textbf{\color{#35bf28}+10.05\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6178ms 1.2828ms 779.5543 Ops/s 695.1549 Ops/s $\textbf{\color{#35bf28}+12.14\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5854ms 1.2091ms 827.0878 Ops/s 734.7614 Ops/s $\textbf{\color{#35bf28}+12.57\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.1937ms 6.0213ms 166.0763 Ops/s 169.0500 Ops/s $\color{#d91a1a}-1.76\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8816ms 0.4600ms 2.1741 KOps/s 2.2137 KOps/s $\color{#d91a1a}-1.79\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8219ms 0.4310ms 2.3201 KOps/s 2.1364 KOps/s $\textbf{\color{#35bf28}+8.60\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.9714ms 5.8743ms 170.2342 Ops/s 172.0062 Ops/s $\color{#d91a1a}-1.03\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.2378ms 0.3447ms 2.9013 KOps/s 2.8594 KOps/s $\color{#35bf28}+1.47\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5491ms 0.3280ms 3.0483 KOps/s 3.2042 KOps/s $\color{#d91a1a}-4.86\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0437ms 5.7755ms 173.1464 Ops/s 172.7730 Ops/s $\color{#35bf28}+0.22\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9225ms 0.3048ms 3.2805 KOps/s 2.9526 KOps/s $\textbf{\color{#35bf28}+11.10\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5525ms 0.3074ms 3.2527 KOps/s 3.8903 KOps/s $\textbf{\color{#d91a1a}-16.39\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.3624ms 6.0887ms 164.2398 Ops/s 166.9019 Ops/s $\color{#d91a1a}-1.60\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.7051ms 0.4572ms 2.1874 KOps/s 2.2663 KOps/s $\color{#d91a1a}-3.48\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6230ms 0.4265ms 2.3445 KOps/s 2.4439 KOps/s $\color{#d91a1a}-4.07\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.5434s 15.8844ms 62.9547 Ops/s 194.2443 Ops/s $\textbf{\color{#d91a1a}-67.59\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 2.8781ms 1.4183ms 705.0762 Ops/s 404.2846 Ops/s $\textbf{\color{#35bf28}+74.40\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 20.2791ms 1.4716ms 679.5426 Ops/s 917.3204 Ops/s $\textbf{\color{#d91a1a}-25.92\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 7.3082ms 5.1219ms 195.2396 Ops/s 190.0694 Ops/s $\color{#35bf28}+2.72\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 8.5338ms 2.0684ms 483.4555 Ops/s 436.2142 Ops/s $\textbf{\color{#35bf28}+10.83\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 8.2133ms 1.2690ms 788.0163 Ops/s 833.3123 Ops/s $\textbf{\color{#d91a1a}-5.44\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.4729s 14.6924ms 68.0626 Ops/s 54.3775 Ops/s $\textbf{\color{#35bf28}+25.17\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 11.2621ms 2.1581ms 463.3728 Ops/s 467.8443 Ops/s $\color{#d91a1a}-0.96\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.4356ms 1.0339ms 967.2159 Ops/s 968.5218 Ops/s $\color{#d91a1a}-0.13\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 35.6746ms 33.2508ms 30.0744 Ops/s 29.9869 Ops/s $\color{#35bf28}+0.29\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.5188ms 18.0296ms 55.4644 Ops/s 57.8355 Ops/s $\color{#d91a1a}-4.10\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 36.1280ms 34.0371ms 29.3797 Ops/s 29.0605 Ops/s $\color{#35bf28}+1.10\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.6239ms 17.9855ms 55.6002 Ops/s 56.3487 Ops/s $\color{#d91a1a}-1.33\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 37.5242ms 35.7908ms 27.9401 Ops/s 27.3286 Ops/s $\color{#35bf28}+2.24\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.8314ms 19.3611ms 51.6498 Ops/s 52.2895 Ops/s $\color{#d91a1a}-1.22\%$

vmoens added 7 commits October 19, 2025 20:56
@vmoens
Update
27c2dc6 
[ghstack-poisoned]
@vmoens
Update
36b0936 
[ghstack-poisoned]
@vmoens
Update
a06c0f3 
[ghstack-poisoned]
@vmoens
Update
86c7b1e 
[ghstack-poisoned]
@vmoens
Update
5869432 
[ghstack-poisoned]
@vmoens
Update
e31da55 
[ghstack-poisoned]
@vmoens
Update
bcd1db8 
[ghstack-poisoned]
This was referenced Oct 22, 2025
Open
Open
vmoens added 5 commits October 22, 2025 12:31
@vmoens
Update
a33925a 
[ghstack-poisoned]
@vmoens
Update
e5ebf6b 
[ghstack-poisoned]
@vmoens
Update
f3bfbc0 
[ghstack-poisoned]
@vmoens
Update
81b4abe 
[ghstack-poisoned]
@vmoens
Update
4e55c02 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 23, 2025
@vmoens
[Feature] Documentation
e254466 
ghstack-source-id: de472c2
Pull-Request: #3192
@vmoens
Update
c7a19f7 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 23, 2025
@vmoens
[Feature] Documentation
0a072b2 
ghstack-source-id: a7175e2
Pull-Request: #3192
@vmoens
Update
b6bb797 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 23, 2025
@vmoens
[Feature] Documentation
9ad02ae 
ghstack-source-id: 7295809
Pull-Request: #3192
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens