Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[CI] Fix doc upload#1739

Merged
vmoens merged 3 commits intomainfrom
fix-doc
Dec 6, 2023
Merged

[CI] Fix doc upload#1739
vmoens merged 3 commits intomainfrom
fix-doc

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Dec 6, 2023 •
edited
Loading

No description provided.

@pytorch-bot
Copy link

pytorch-bot bot commented Dec 6, 2023 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1739

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (9 Unrelated Failures)

As of commit f54bcde with merge base ffc62cc (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 6, 2023
@vmoens vmoens marked this pull request as ready for review December 6, 2023 17:38
@github-actions
Copy link
Contributor

github-actions bot commented Dec 6, 2023 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}11$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 62.4569ms 62.0688ms 16.1111 Ops/s 14.9760 Ops/s $\textbf{\color{#35bf28}+7.58\%}$
test_sync 35.0271ms 33.9150ms 29.4855 Ops/s 26.6648 Ops/s $\textbf{\color{#35bf28}+10.58\%}$
test_async 78.0095ms 33.5222ms 29.8310 Ops/s 29.6853 Ops/s $\color{#35bf28}+0.49\%$
test_simple 0.4990s 0.4409s 2.2683 Ops/s 2.2841 Ops/s $\color{#d91a1a}-0.70\%$
test_transformed 0.6844s 0.6217s 1.6084 Ops/s 1.6299 Ops/s $\color{#d91a1a}-1.32\%$
test_serial 1.4160s 1.3587s 0.7360 Ops/s 0.7405 Ops/s $\color{#d91a1a}-0.62\%$
test_parallel 1.3478s 1.2987s 0.7700 Ops/s 0.7746 Ops/s $\color{#d91a1a}-0.60\%$
test_step_mdp_speed[True-True-True-True-True] 0.1736ms 23.2154μs 43.0748 KOps/s 43.6226 KOps/s $\color{#d91a1a}-1.26\%$
test_step_mdp_speed[True-True-True-True-False] 39.6340μs 13.9943μs 71.4579 KOps/s 72.0543 KOps/s $\color{#d91a1a}-0.83\%$
test_step_mdp_speed[True-True-True-False-True] 41.9880μs 14.2105μs 70.3706 KOps/s 71.3074 KOps/s $\color{#d91a1a}-1.31\%$
test_step_mdp_speed[True-True-True-False-False] 31.6290μs 8.5215μs 117.3499 KOps/s 119.9983 KOps/s $\color{#d91a1a}-2.21\%$
test_step_mdp_speed[True-True-False-True-True] 53.2690μs 24.7075μs 40.4735 KOps/s 40.9871 KOps/s $\color{#d91a1a}-1.25\%$
test_step_mdp_speed[True-True-False-True-False] 49.5730μs 15.4124μs 64.8829 KOps/s 65.6526 KOps/s $\color{#d91a1a}-1.17\%$
test_step_mdp_speed[True-True-False-False-True] 37.2690μs 15.6900μs 63.7347 KOps/s 65.2740 KOps/s $\color{#d91a1a}-2.36\%$
test_step_mdp_speed[True-True-False-False-False] 49.7430μs 9.8766μs 101.2492 KOps/s 101.7291 KOps/s $\color{#d91a1a}-0.47\%$
test_step_mdp_speed[True-False-True-True-True] 51.6670μs 26.1011μs 38.3126 KOps/s 38.3072 KOps/s $\color{#35bf28}+0.01\%$
test_step_mdp_speed[True-False-True-True-False] 47.6690μs 16.9205μs 59.1000 KOps/s 59.8251 KOps/s $\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-False-True-False-True] 66.3840μs 15.4527μs 64.7137 KOps/s 64.6928 KOps/s $\color{#35bf28}+0.03\%$
test_step_mdp_speed[True-False-True-False-False] 42.1290μs 9.9821μs 100.1796 KOps/s 102.1780 KOps/s $\color{#d91a1a}-1.96\%$
test_step_mdp_speed[True-False-False-True-True] 64.6400μs 27.4374μs 36.4465 KOps/s 37.0650 KOps/s $\color{#d91a1a}-1.67\%$
test_step_mdp_speed[True-False-False-True-False] 48.5600μs 17.9396μs 55.7425 KOps/s 56.1032 KOps/s $\color{#d91a1a}-0.64\%$
test_step_mdp_speed[True-False-False-False-True] 45.6660μs 16.6999μs 59.8807 KOps/s 60.3579 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[True-False-False-False-False] 30.1660μs 11.1206μs 89.9232 KOps/s 91.3188 KOps/s $\color{#d91a1a}-1.53\%$
test_step_mdp_speed[False-True-True-True-True] 4.1720ms 26.2553μs 38.0875 KOps/s 38.6812 KOps/s $\color{#d91a1a}-1.53\%$
test_step_mdp_speed[False-True-True-True-False] 71.1530μs 17.2500μs 57.9709 KOps/s 59.9210 KOps/s $\color{#d91a1a}-3.25\%$
test_step_mdp_speed[False-True-True-False-True] 67.7160μs 18.4536μs 54.1900 KOps/s 55.8628 KOps/s $\color{#d91a1a}-2.99\%$
test_step_mdp_speed[False-True-True-False-False] 34.0330μs 11.2836μs 88.6242 KOps/s 90.4378 KOps/s $\color{#d91a1a}-2.01\%$
test_step_mdp_speed[False-True-False-True-True] 80.4500μs 27.2038μs 36.7596 KOps/s 37.0213 KOps/s $\color{#d91a1a}-0.71\%$
test_step_mdp_speed[False-True-False-True-False] 50.9350μs 17.8999μs 55.8661 KOps/s 55.3598 KOps/s $\color{#35bf28}+0.91\%$
test_step_mdp_speed[False-True-False-False-True] 62.0260μs 19.3536μs 51.6700 KOps/s 52.7390 KOps/s $\color{#d91a1a}-2.03\%$
test_step_mdp_speed[False-True-False-False-False] 34.0640μs 12.3619μs 80.8939 KOps/s 82.0153 KOps/s $\color{#d91a1a}-1.37\%$
test_step_mdp_speed[False-False-True-True-True] 74.5990μs 28.4584μs 35.1390 KOps/s 35.2811 KOps/s $\color{#d91a1a}-0.40\%$
test_step_mdp_speed[False-False-True-True-False] 53.2290μs 19.1870μs 52.1186 KOps/s 51.8710 KOps/s $\color{#35bf28}+0.48\%$
test_step_mdp_speed[False-False-True-False-True] 41.0370μs 19.0835μs 52.4013 KOps/s 52.2036 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[False-False-True-False-False] 45.8460μs 12.2843μs 81.4048 KOps/s 81.5846 KOps/s $\color{#d91a1a}-0.22\%$
test_step_mdp_speed[False-False-False-True-True] 57.7880μs 29.8753μs 33.4724 KOps/s 33.6816 KOps/s $\color{#d91a1a}-0.62\%$
test_step_mdp_speed[False-False-False-True-False] 50.6850μs 20.4206μs 48.9702 KOps/s 48.6543 KOps/s $\color{#35bf28}+0.65\%$
test_step_mdp_speed[False-False-False-False-True] 52.7190μs 20.3497μs 49.1409 KOps/s 50.0936 KOps/s $\color{#d91a1a}-1.90\%$
test_step_mdp_speed[False-False-False-False-False] 33.6830μs 13.4472μs 74.3651 KOps/s 75.5564 KOps/s $\color{#d91a1a}-1.58\%$
test_values[generalized_advantage_estimate-True-True] 13.4537ms 12.0748ms 82.8171 Ops/s 82.1206 Ops/s $\color{#35bf28}+0.85\%$
test_values[vec_generalized_advantage_estimate-True-True] 35.6928ms 27.6780ms 36.1297 Ops/s 36.5960 Ops/s $\color{#d91a1a}-1.27\%$
test_values[td0_return_estimate-False-False] 0.2612ms 0.1780ms 5.6195 KOps/s 5.5321 KOps/s $\color{#35bf28}+1.58\%$
test_values[td1_return_estimate-False-False] 26.3520ms 25.7203ms 38.8798 Ops/s 37.9851 Ops/s $\color{#35bf28}+2.36\%$
test_values[vec_td1_return_estimate-False-False] 35.8102ms 27.6261ms 36.1977 Ops/s 36.7266 Ops/s $\color{#d91a1a}-1.44\%$
test_values[td_lambda_return_estimate-True-False] 45.0686ms 36.6596ms 27.2780 Ops/s 27.2769 Ops/s $+0.00\%$
test_values[vec_td_lambda_return_estimate-True-False] 34.9541ms 27.5164ms 36.3420 Ops/s 36.3462 Ops/s $\color{#d91a1a}-0.01\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 11.3114ms 8.1443ms 122.7858 Ops/s 121.2623 Ops/s $\color{#35bf28}+1.26\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 10.5588ms 1.9861ms 503.4979 Ops/s 463.2277 Ops/s $\textbf{\color{#35bf28}+8.69\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 1.3065ms 0.4480ms 2.2319 KOps/s 2.2385 KOps/s $\color{#d91a1a}-0.30\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 46.4763ms 40.5739ms 24.6464 Ops/s 25.0370 Ops/s $\color{#d91a1a}-1.56\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 15.7177ms 2.9033ms 344.4393 Ops/s 390.0654 Ops/s $\textbf{\color{#d91a1a}-11.70\%}$
test_dqn_speed 11.2259ms 1.6619ms 601.7100 Ops/s 594.7424 Ops/s $\color{#35bf28}+1.17\%$
test_ddpg_speed 12.9135ms 3.6984ms 270.3875 Ops/s 265.5667 Ops/s $\color{#35bf28}+1.82\%$
test_sac_speed 20.0443ms 10.4417ms 95.7700 Ops/s 94.3970 Ops/s $\color{#35bf28}+1.45\%$
test_redq_speed 29.3826ms 20.0721ms 49.8203 Ops/s 50.4186 Ops/s $\color{#d91a1a}-1.19\%$
test_redq_deprec_speed 93.2201ms 16.7588ms 59.6703 Ops/s 65.4454 Ops/s $\textbf{\color{#d91a1a}-8.82\%}$
test_td3_speed 19.2709ms 10.7486ms 93.0352 Ops/s 91.9589 Ops/s $\color{#35bf28}+1.17\%$
test_cql_speed 47.5770ms 38.8862ms 25.7161 Ops/s 25.1514 Ops/s $\color{#35bf28}+2.24\%$
test_a2c_speed 17.1446ms 8.2953ms 120.5498 Ops/s 115.1173 Ops/s $\color{#35bf28}+4.72\%$
test_ppo_speed 24.7220ms 9.1318ms 109.5076 Ops/s 110.8651 Ops/s $\color{#d91a1a}-1.22\%$
test_reinforce_speed 15.8988ms 7.9052ms 126.4994 Ops/s 129.2874 Ops/s $\color{#d91a1a}-2.16\%$
test_iql_speed 44.3881ms 35.5821ms 28.1040 Ops/s 28.0735 Ops/s $\color{#35bf28}+0.11\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9265ms 1.9076ms 524.2232 Ops/s 526.1666 Ops/s $\color{#d91a1a}-0.37\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1123s 2.3849ms 419.3085 Ops/s 491.4276 Ops/s $\textbf{\color{#d91a1a}-14.68\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.7888ms 2.1586ms 463.2717 Ops/s 492.6048 Ops/s $\textbf{\color{#d91a1a}-5.95\%}$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0877ms 2.0212ms 494.7673 Ops/s 523.4436 Ops/s $\textbf{\color{#d91a1a}-5.48\%}$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1082s 2.3173ms 431.5322 Ops/s 499.7295 Ops/s $\textbf{\color{#d91a1a}-13.65\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.3420ms 2.0863ms 479.3097 Ops/s 492.0028 Ops/s $\color{#d91a1a}-2.58\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.5493ms 1.8997ms 526.4099 Ops/s 522.9126 Ops/s $\color{#35bf28}+0.67\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1153s 2.3099ms 432.9205 Ops/s 495.4940 Ops/s $\textbf{\color{#d91a1a}-12.63\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.2936ms 2.0381ms 490.6580 Ops/s 485.2756 Ops/s $\color{#35bf28}+1.11\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.2316ms 1.9679ms 508.1530 Ops/s 523.9757 Ops/s $\color{#d91a1a}-3.02\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1224s 2.3609ms 423.5704 Ops/s 493.5614 Ops/s $\textbf{\color{#d91a1a}-14.18\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.2726ms 2.1454ms 466.1085 Ops/s 490.4542 Ops/s $\color{#d91a1a}-4.96\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0417ms 2.0700ms 483.0903 Ops/s 523.4609 Ops/s $\textbf{\color{#d91a1a}-7.71\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1388s 2.4057ms 415.6814 Ops/s 489.9113 Ops/s $\textbf{\color{#d91a1a}-15.15\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.1455ms 2.0983ms 476.5670 Ops/s 488.9789 Ops/s $\color{#d91a1a}-2.54\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.2752ms 1.9245ms 519.6278 Ops/s 522.3811 Ops/s $\color{#d91a1a}-0.53\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1557s 2.4297ms 411.5791 Ops/s 489.5738 Ops/s $\textbf{\color{#d91a1a}-15.93\%}$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.7283ms 2.1335ms 468.7065 Ops/s 485.4379 Ops/s $\color{#d91a1a}-3.45\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1884s 18.9116ms 52.8777 Ops/s 54.1238 Ops/s $\color{#d91a1a}-2.30\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.1218s 16.9415ms 59.0266 Ops/s 60.3820 Ops/s $\color{#d91a1a}-2.24\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 0.1216s 17.0102ms 58.7881 Ops/s 60.0694 Ops/s $\color{#d91a1a}-2.13\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1253s 17.2531ms 57.9607 Ops/s 54.2675 Ops/s $\textbf{\color{#35bf28}+6.81\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1221s 16.9346ms 59.0507 Ops/s 60.2373 Ops/s $\color{#d91a1a}-1.97\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 0.1193s 17.0129ms 58.7790 Ops/s 59.9137 Ops/s $\color{#d91a1a}-1.89\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1290s 17.3608ms 57.6011 Ops/s 60.0091 Ops/s $\color{#d91a1a}-4.01\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.1196s 17.1924ms 58.1652 Ops/s 59.0153 Ops/s $\color{#d91a1a}-1.44\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 0.1215s 16.8418ms 59.3760 Ops/s 59.2450 Ops/s $\color{#35bf28}+0.22\%$

@github-actions
Copy link
Contributor

github-actions bot commented Dec 6, 2023 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}7$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1230s 0.1211s 8.2568 Ops/s 8.3363 Ops/s $\color{#d91a1a}-0.95\%$
test_sync 0.1125s 0.1039s 9.6274 Ops/s 9.6974 Ops/s $\color{#d91a1a}-0.72\%$
test_async 0.2816s 0.1007s 9.9314 Ops/s 9.9401 Ops/s $\color{#d91a1a}-0.09\%$
test_single_pixels 0.1319s 0.1313s 7.6169 Ops/s 7.6866 Ops/s $\color{#d91a1a}-0.91\%$
test_sync_pixels 96.9462ms 94.9839ms 10.5281 Ops/s 10.4034 Ops/s $\color{#35bf28}+1.20\%$
test_async_pixels 0.1850s 91.8215ms 10.8907 Ops/s 10.8636 Ops/s $\color{#35bf28}+0.25\%$
test_simple 0.9531s 0.8767s 1.1407 Ops/s 1.1516 Ops/s $\color{#d91a1a}-0.95\%$
test_transformed 1.1815s 1.1198s 0.8930 Ops/s 0.9141 Ops/s $\color{#d91a1a}-2.31\%$
test_serial 2.5247s 2.4683s 0.4051 Ops/s 0.4132 Ops/s $\color{#d91a1a}-1.96\%$
test_parallel 2.5642s 2.4800s 0.4032 Ops/s 0.4046 Ops/s $\color{#d91a1a}-0.33\%$
test_step_mdp_speed[True-True-True-True-True] 0.1156ms 34.2554μs 29.1925 KOps/s 28.2348 KOps/s $\color{#35bf28}+3.39\%$
test_step_mdp_speed[True-True-True-True-False] 45.8120μs 20.7429μs 48.2092 KOps/s 47.9376 KOps/s $\color{#35bf28}+0.57\%$
test_step_mdp_speed[True-True-True-False-True] 36.9420μs 20.6316μs 48.4695 KOps/s 47.4229 KOps/s $\color{#35bf28}+2.21\%$
test_step_mdp_speed[True-True-True-False-False] 28.3120μs 12.2435μs 81.6759 KOps/s 79.9276 KOps/s $\color{#35bf28}+2.19\%$
test_step_mdp_speed[True-True-False-True-True] 62.4530μs 36.2162μs 27.6120 KOps/s 27.0986 KOps/s $\color{#35bf28}+1.89\%$
test_step_mdp_speed[True-True-False-True-False] 37.9120μs 22.3886μs 44.6656 KOps/s 44.4035 KOps/s $\color{#35bf28}+0.59\%$
test_step_mdp_speed[True-True-False-False-True] 46.2920μs 22.3619μs 44.7188 KOps/s 44.0247 KOps/s $\color{#35bf28}+1.58\%$
test_step_mdp_speed[True-True-False-False-False] 31.4220μs 13.9939μs 71.4596 KOps/s 69.8674 KOps/s $\color{#35bf28}+2.28\%$
test_step_mdp_speed[True-False-True-True-True] 57.7830μs 38.7236μs 25.8240 KOps/s 25.5162 KOps/s $\color{#35bf28}+1.21\%$
test_step_mdp_speed[True-False-True-True-False] 49.8830μs 24.4085μs 40.9693 KOps/s 40.8175 KOps/s $\color{#35bf28}+0.37\%$
test_step_mdp_speed[True-False-True-False-True] 56.6430μs 22.2675μs 44.9085 KOps/s 44.4331 KOps/s $\color{#35bf28}+1.07\%$
test_step_mdp_speed[True-False-True-False-False] 33.1120μs 14.0712μs 71.0672 KOps/s 69.7485 KOps/s $\color{#35bf28}+1.89\%$
test_step_mdp_speed[True-False-False-True-True] 71.7430μs 40.5382μs 24.6681 KOps/s 24.5448 KOps/s $\color{#35bf28}+0.50\%$
test_step_mdp_speed[True-False-False-True-False] 44.9120μs 25.9002μs 38.6098 KOps/s 37.6899 KOps/s $\color{#35bf28}+2.44\%$
test_step_mdp_speed[True-False-False-False-True] 41.7920μs 24.1921μs 41.3358 KOps/s 41.1322 KOps/s $\color{#35bf28}+0.49\%$
test_step_mdp_speed[True-False-False-False-False] 39.9520μs 15.6990μs 63.6983 KOps/s 63.1641 KOps/s $\color{#35bf28}+0.85\%$
test_step_mdp_speed[False-True-True-True-True] 59.3420μs 38.9463μs 25.6763 KOps/s 25.6511 KOps/s $\color{#35bf28}+0.10\%$
test_step_mdp_speed[False-True-True-True-False] 44.0520μs 24.5824μs 40.6795 KOps/s 40.5570 KOps/s $\color{#35bf28}+0.30\%$
test_step_mdp_speed[False-True-True-False-True] 46.4620μs 26.6202μs 37.5655 KOps/s 37.4901 KOps/s $\color{#35bf28}+0.20\%$
test_step_mdp_speed[False-True-True-False-False] 31.4710μs 16.0421μs 62.3359 KOps/s 60.9153 KOps/s $\color{#35bf28}+2.33\%$
test_step_mdp_speed[False-True-False-True-True] 73.7140μs 40.3072μs 24.8095 KOps/s 24.3214 KOps/s $\color{#35bf28}+2.01\%$
test_step_mdp_speed[False-True-False-True-False] 50.5530μs 25.9494μs 38.5366 KOps/s 37.7896 KOps/s $\color{#35bf28}+1.98\%$
test_step_mdp_speed[False-True-False-False-True] 44.6120μs 28.4411μs 35.1604 KOps/s 35.3542 KOps/s $\color{#d91a1a}-0.55\%$
test_step_mdp_speed[False-True-False-False-False] 35.3320μs 17.9586μs 55.6836 KOps/s 55.6841 KOps/s $-0.00\%$
test_step_mdp_speed[False-False-True-True-True] 62.3420μs 42.1970μs 23.6984 KOps/s 23.5496 KOps/s $\color{#35bf28}+0.63\%$
test_step_mdp_speed[False-False-True-True-False] 43.8920μs 27.9757μs 35.7453 KOps/s 35.5092 KOps/s $\color{#35bf28}+0.67\%$
test_step_mdp_speed[False-False-True-False-True] 54.7730μs 28.4454μs 35.1550 KOps/s 35.5394 KOps/s $\color{#d91a1a}-1.08\%$
test_step_mdp_speed[False-False-True-False-False] 55.2220μs 18.2659μs 54.7467 KOps/s 55.5909 KOps/s $\color{#d91a1a}-1.52\%$
test_step_mdp_speed[False-False-False-True-True] 63.4230μs 44.3900μs 22.5276 KOps/s 22.9663 KOps/s $\color{#d91a1a}-1.91\%$
test_step_mdp_speed[False-False-False-True-False] 63.0230μs 30.3488μs 32.9503 KOps/s 33.6037 KOps/s $\color{#d91a1a}-1.94\%$
test_step_mdp_speed[False-False-False-False-True] 51.0020μs 30.0756μs 33.2495 KOps/s 33.9035 KOps/s $\color{#d91a1a}-1.93\%$
test_step_mdp_speed[False-False-False-False-False] 42.8320μs 19.6812μs 50.8098 KOps/s 50.1935 KOps/s $\color{#35bf28}+1.23\%$
test_values[generalized_advantage_estimate-True-True] 25.3680ms 24.8107ms 40.3052 Ops/s 41.5119 Ops/s $\color{#d91a1a}-2.91\%$
test_values[vec_generalized_advantage_estimate-True-True] 86.7802ms 3.2867ms 304.2605 Ops/s 302.1244 Ops/s $\color{#35bf28}+0.71\%$
test_values[td0_return_estimate-False-False] 0.1003ms 63.6093μs 15.7210 KOps/s 16.0844 KOps/s $\color{#d91a1a}-2.26\%$
test_values[td1_return_estimate-False-False] 56.6762ms 56.1913ms 17.7964 Ops/s 19.0145 Ops/s $\textbf{\color{#d91a1a}-6.41\%}$
test_values[vec_td1_return_estimate-False-False] 2.0406ms 1.7241ms 580.0232 Ops/s 578.0962 Ops/s $\color{#35bf28}+0.33\%$
test_values[td_lambda_return_estimate-True-False] 87.8953ms 86.2301ms 11.5969 Ops/s 11.1285 Ops/s $\color{#35bf28}+4.21\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.0222ms 1.7342ms 576.6448 Ops/s 580.4118 Ops/s $\color{#d91a1a}-0.65\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.7392ms 23.6215ms 42.3343 Ops/s 43.2882 Ops/s $\color{#d91a1a}-2.20\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8849ms 0.7127ms 1.4031 KOps/s 1.4228 KOps/s $\color{#d91a1a}-1.38\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7473ms 0.6720ms 1.4880 KOps/s 1.4958 KOps/s $\color{#d91a1a}-0.52\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4930ms 1.4662ms 682.0524 Ops/s 686.9158 Ops/s $\color{#d91a1a}-0.71\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9505ms 0.7014ms 1.4258 KOps/s 1.4330 KOps/s $\color{#d91a1a}-0.50\%$
test_dqn_speed 7.6118ms 1.4714ms 679.6303 Ops/s 691.1134 Ops/s $\color{#d91a1a}-1.66\%$
test_ddpg_speed 4.6609ms 3.2965ms 303.3478 Ops/s 303.7901 Ops/s $\color{#d91a1a}-0.15\%$
test_sac_speed 10.3358ms 9.2124ms 108.5495 Ops/s 107.5920 Ops/s $\color{#35bf28}+0.89\%$
test_redq_speed 19.5815ms 16.8070ms 59.4989 Ops/s 59.2169 Ops/s $\color{#35bf28}+0.48\%$
test_redq_deprec_speed 0.1025s 14.1001ms 70.9216 Ops/s 75.4990 Ops/s $\textbf{\color{#d91a1a}-6.06\%}$
test_td3_speed 9.5202ms 9.3353ms 107.1202 Ops/s 105.9796 Ops/s $\color{#35bf28}+1.08\%$
test_cql_speed 0.1337s 34.4027ms 29.0675 Ops/s 31.9448 Ops/s $\textbf{\color{#d91a1a}-9.01\%}$
test_a2c_speed 8.4601ms 7.0169ms 142.5134 Ops/s 138.8935 Ops/s $\color{#35bf28}+2.61\%$
test_ppo_speed 8.7850ms 7.3110ms 136.7807 Ops/s 133.5456 Ops/s $\color{#35bf28}+2.42\%$
test_reinforce_speed 7.5083ms 6.0518ms 165.2397 Ops/s 162.3136 Ops/s $\color{#35bf28}+1.80\%$
test_iql_speed 28.8060ms 27.0311ms 36.9944 Ops/s 36.5882 Ops/s $\color{#35bf28}+1.11\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.1670ms 2.5354ms 394.4113 Ops/s 398.3367 Ops/s $\color{#d91a1a}-0.99\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 3.8125ms 2.6971ms 370.7733 Ops/s 331.5528 Ops/s $\textbf{\color{#35bf28}+11.83\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.3650ms 2.6973ms 370.7410 Ops/s 372.2709 Ops/s $\color{#d91a1a}-0.41\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.1246ms 2.5236ms 396.2629 Ops/s 397.9673 Ops/s $\color{#d91a1a}-0.43\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 3.9176ms 2.6893ms 371.8476 Ops/s 328.8600 Ops/s $\textbf{\color{#35bf28}+13.07\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.6779ms 2.7043ms 369.7860 Ops/s 369.9539 Ops/s $\color{#d91a1a}-0.05\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1684ms 2.5100ms 398.3997 Ops/s 396.2704 Ops/s $\color{#35bf28}+0.54\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 3.7490ms 2.6984ms 370.5878 Ops/s 329.8786 Ops/s $\textbf{\color{#35bf28}+12.34\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.6226ms 2.6941ms 371.1875 Ops/s 369.4063 Ops/s $\color{#35bf28}+0.48\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.1984ms 2.5054ms 399.1390 Ops/s 396.2270 Ops/s $\color{#35bf28}+0.73\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 3.7498ms 2.7082ms 369.2495 Ops/s 330.0929 Ops/s $\textbf{\color{#35bf28}+11.86\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.9601ms 2.7033ms 369.9134 Ops/s 367.0803 Ops/s $\color{#35bf28}+0.77\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.2452ms 2.5109ms 398.2694 Ops/s 394.6903 Ops/s $\color{#35bf28}+0.91\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 4.2788ms 2.7179ms 367.9245 Ops/s 327.6362 Ops/s $\textbf{\color{#35bf28}+12.30\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.0708ms 2.7076ms 369.3354 Ops/s 368.4827 Ops/s $\color{#35bf28}+0.23\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.7364ms 2.5110ms 398.2479 Ops/s 395.0193 Ops/s $\color{#35bf28}+0.82\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 3.8019ms 2.7078ms 369.2993 Ops/s 328.0052 Ops/s $\textbf{\color{#35bf28}+12.59\%}$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.0583ms 2.7121ms 368.7232 Ops/s 367.2563 Ops/s $\color{#35bf28}+0.40\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.2282s 19.9029ms 50.2438 Ops/s 51.4196 Ops/s $\color{#d91a1a}-2.29\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.1281s 17.8001ms 56.1794 Ops/s 56.2106 Ops/s $\color{#d91a1a}-0.06\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 0.1314s 17.7812ms 56.2391 Ops/s 55.8524 Ops/s $\color{#35bf28}+0.69\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1301s 15.5977ms 64.1119 Ops/s 55.8790 Ops/s $\textbf{\color{#35bf28}+14.73\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1286s 17.9081ms 55.8407 Ops/s 55.6356 Ops/s $\color{#35bf28}+0.37\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 0.1296s 17.8896ms 55.8983 Ops/s 64.4824 Ops/s $\textbf{\color{#d91a1a}-13.31\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1296s 17.9403ms 55.7403 Ops/s 56.5178 Ops/s $\color{#d91a1a}-1.38\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.1311s 17.7625ms 56.2983 Ops/s 56.0888 Ops/s $\color{#35bf28}+0.37\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 0.1288s 17.8787ms 55.9323 Ops/s 55.7210 Ops/s $\color{#35bf28}+0.38\%$

@vmoens vmoens added the ciflow/docs tests full docs CI label Dec 6, 2023
@pytorch-bot
Copy link

pytorch-bot bot commented Dec 6, 2023

No ciflow labels are configured for this repo.
For information on how to enable CIFlow bot see this wiki

@vmoens vmoens merged commit a772a43 into main Dec 6, 2023
@vmoens vmoens deleted the fix-doc branch December 6, 2023 20:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ciflow/docs tests full docs CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens @facebook-github-bot