[Quality] Fix flaky test #3211

vmoens · 2025-10-18T22:53:40Z

Stack from ghstack (oldest at bottom):

[ghstack-poisoned]

pytorch-bot · 2025-10-18T22:53:44Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3211

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 7 New Failures, 1 Cancelled Job, 3 Unrelated Failures

As of commit 5c2d8a8 with merge base 963fdd4 ():

NEW FAILURES - The following jobs have failed:

Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
Process completed with exit code 139.
Generate documentation / build-docs (3.9, 12.8) / linux-job (gh)
RuntimeError: Command docker exec -t 2ea6fee00aac2b1ffb8f0d2043758182b922eae2a9a05f4fe6e86d89294e0e40 /exec failed with exit code 1
Habitat Tests on Linux / tests (3.9, 12.8) / linux-job (gh)
RuntimeError: Command docker exec -t 7a0a8ed043b1f7f53b8954f1a090ff17325b1f227e8708e5f8d5ef73d9bbdf39 /exec failed with exit code 1
Libs Tests on Linux / unittests-gym (3.9, 12.8) / linux-job (gh)
RuntimeError: Command docker exec -t c1c4c729266f8dee4ea3c6b6a89d532c81b2ef426005e79c7b5d96da9fea8931 /exec failed with exit code 1
Libs Tests on Linux / unittests-sklearn (3.10, 12.8) / linux-job (gh)
RuntimeError: Command docker exec -t 2d4c872144e9ededa413b18b21c8f5a98b7ea38f5873998ee1e562ab14aaf906 /exec failed with exit code 2
SOTA Tests on Linux / tests (3.9, 12.8) / linux-job (gh)
RuntimeError: Command docker exec -t caf6414530b14a7c7a29d8bd7f31dd1ba543eebb86c9b12e591191b6177348c4 /exec failed with exit code 1
Unit-tests on Windows / unittests-cpu (3.10, windows.4xlarge, cpu) / windows-job (gh)
Process completed with exit code 2.

CANCELLED JOB - The following job was cancelled. Please retry:

LLM Tests on Linux / unittests (3.9, 12.8) / linux-job (gh)
##[error]The operation was canceled.

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

Unit-tests on Linux / tests-gpu (3.11, 12.8) / linux-job (gh) (trunk failure)
test/test_collector.py::TestPolicyFactory::test_weight_update
Unit-tests on Linux / tests-olddeps (3.9, 11.6) / linux-job (gh) (trunk failure)
test/test_collector.py::TestPolicyFactory::test_weight_update
Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job (gh) (trunk failure)
test/test_collector.py::TestPolicyFactory::test_weight_update

This comment was automatically generated by Dr. CI and updates every 15 minutes.

ghstack-source-id: 839143f Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: e41e8b1 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: f9b82b5 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: fa649fd Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: ab51147 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: 609aeb2 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: 2b57e12 Pull-Request: #3211

github-actions · 2025-10-20T02:02:09Z

$\color{#D29922}\textsf{\Large&#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}29$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo `HEAD`	Change
test_tensor_to_bytestream_speed[pickle]	83.7821μs	82.2827μs	12.1532 KOps/s	12.1245 KOps/s	$\color{#35bf28}+0.24\%$
test_tensor_to_bytestream_speed[torch.save]	0.1416ms	0.1399ms	7.1485 KOps/s	7.0519 KOps/s	$\color{#35bf28}+1.37\%$
test_tensor_to_bytestream_speed[untyped_storage]	0.1238s	0.1235s	8.0943 Ops/s	7.9507 Ops/s	$\color{#35bf28}+1.81\%$
test_tensor_to_bytestream_speed[numpy]	2.8476μs	2.8299μs	353.3671 KOps/s	352.5359 KOps/s	$\color{#35bf28}+0.24\%$
test_tensor_to_bytestream_speed[safetensors]	42.4839μs	42.2704μs	23.6572 KOps/s	21.8024 KOps/s	$\textbf{\color{#35bf28}+8.51\%}$
test_simple	0.5533s	0.5513s	1.8140 Ops/s	1.7044 Ops/s	$\textbf{\color{#35bf28}+6.43\%}$
test_transformed	1.2338s	1.1413s	0.8762 Ops/s	0.8554 Ops/s	$\color{#35bf28}+2.44\%$
test_serial	1.6698s	1.6658s	0.6003 Ops/s	0.5792 Ops/s	$\color{#35bf28}+3.64\%$
test_parallel	1.1787s	1.1075s	0.9029 Ops/s	0.8982 Ops/s	$\color{#35bf28}+0.53\%$
test_step_mdp_speed[True-True-True-True-True]	0.2045ms	45.9033μs	21.7849 KOps/s	22.6229 KOps/s	$\color{#d91a1a}-3.70\%$
test_step_mdp_speed[True-True-True-True-False]	46.5410μs	25.4471μs	39.2971 KOps/s	40.0837 KOps/s	$\color{#d91a1a}-1.96\%$
test_step_mdp_speed[True-True-True-False-True]	57.9910μs	25.7952μs	38.7669 KOps/s	39.5183 KOps/s	$\color{#d91a1a}-1.90\%$
test_step_mdp_speed[True-True-True-False-False]	38.5000μs	14.1979μs	70.4330 KOps/s	71.1010 KOps/s	$\color{#d91a1a}-0.94\%$
test_step_mdp_speed[True-True-False-True-True]	88.1610μs	48.2474μs	20.7265 KOps/s	20.8623 KOps/s	$\color{#d91a1a}-0.65\%$
test_step_mdp_speed[True-True-False-True-False]	59.9610μs	28.1090μs	35.5758 KOps/s	35.6384 KOps/s	$\color{#d91a1a}-0.18\%$
test_step_mdp_speed[True-True-False-False-True]	62.2910μs	28.6570μs	34.8955 KOps/s	35.1691 KOps/s	$\color{#d91a1a}-0.78\%$
test_step_mdp_speed[True-True-False-False-False]	48.9110μs	17.1183μs	58.4171 KOps/s	58.9801 KOps/s	$\color{#d91a1a}-0.95\%$
test_step_mdp_speed[True-False-True-True-True]	80.7710μs	51.8473μs	19.2874 KOps/s	19.7789 KOps/s	$\color{#d91a1a}-2.49\%$
test_step_mdp_speed[True-False-True-True-False]	87.6010μs	30.9297μs	32.3314 KOps/s	32.6186 KOps/s	$\color{#d91a1a}-0.88\%$
test_step_mdp_speed[True-False-True-False-True]	63.3110μs	28.6357μs	34.9215 KOps/s	36.2261 KOps/s	$\color{#d91a1a}-3.60\%$
test_step_mdp_speed[True-False-True-False-False]	50.1710μs	16.9836μs	58.8804 KOps/s	59.4787 KOps/s	$\color{#d91a1a}-1.01\%$
test_step_mdp_speed[True-False-False-True-True]	90.2110μs	53.5817μs	18.6631 KOps/s	18.7427 KOps/s	$\color{#d91a1a}-0.42\%$
test_step_mdp_speed[True-False-False-True-False]	73.0910μs	33.3262μs	30.0064 KOps/s	30.2218 KOps/s	$\color{#d91a1a}-0.71\%$
test_step_mdp_speed[True-False-False-False-True]	63.4110μs	30.7999μs	32.4677 KOps/s	32.9833 KOps/s	$\color{#d91a1a}-1.56\%$
test_step_mdp_speed[True-False-False-False-False]	45.5910μs	19.3158μs	51.7711 KOps/s	51.8154 KOps/s	$\color{#d91a1a}-0.09\%$
test_step_mdp_speed[False-True-True-True-True]	77.9820μs	50.9361μs	19.6324 KOps/s	19.7330 KOps/s	$\color{#d91a1a}-0.51\%$
test_step_mdp_speed[False-True-True-True-False]	56.1310μs	30.7987μs	32.4689 KOps/s	32.9417 KOps/s	$\color{#d91a1a}-1.44\%$
test_step_mdp_speed[False-True-True-False-True]	2.3922ms	33.1638μs	30.1534 KOps/s	30.8579 KOps/s	$\color{#d91a1a}-2.28\%$
test_step_mdp_speed[False-True-True-False-False]	51.0200μs	18.5960μs	53.7751 KOps/s	53.3063 KOps/s	$\color{#35bf28}+0.88\%$
test_step_mdp_speed[False-True-False-True-True]	99.6610μs	52.9016μs	18.9030 KOps/s	18.6629 KOps/s	$\color{#35bf28}+1.29\%$
test_step_mdp_speed[False-True-False-True-False]	66.4820μs	33.3108μs	30.0203 KOps/s	29.7869 KOps/s	$\color{#35bf28}+0.78\%$
test_step_mdp_speed[False-True-False-False-True]	65.3710μs	34.6608μs	28.8511 KOps/s	29.2358 KOps/s	$\color{#d91a1a}-1.32\%$
test_step_mdp_speed[False-True-False-False-False]	48.9310μs	21.2995μs	46.9495 KOps/s	46.3817 KOps/s	$\color{#35bf28}+1.22\%$
test_step_mdp_speed[False-False-True-True-True]	90.2720μs	56.3435μs	17.7483 KOps/s	18.0362 KOps/s	$\color{#d91a1a}-1.60\%$
test_step_mdp_speed[False-False-True-True-False]	65.4210μs	36.4515μs	27.4337 KOps/s	27.7314 KOps/s	$\color{#d91a1a}-1.07\%$
test_step_mdp_speed[False-False-True-False-True]	62.6010μs	34.9473μs	28.6145 KOps/s	29.3301 KOps/s	$\color{#d91a1a}-2.44\%$
test_step_mdp_speed[False-False-True-False-False]	50.1810μs	21.1224μs	47.3430 KOps/s	47.1196 KOps/s	$\color{#35bf28}+0.47\%$
test_step_mdp_speed[False-False-False-True-True]	0.1233ms	58.1117μs	17.2082 KOps/s	17.1879 KOps/s	$\color{#35bf28}+0.12\%$
test_step_mdp_speed[False-False-False-True-False]	64.7810μs	38.8602μs	25.7333 KOps/s	25.9570 KOps/s	$\color{#d91a1a}-0.86\%$
test_step_mdp_speed[False-False-False-False-True]	66.6910μs	36.4339μs	27.4470 KOps/s	27.7922 KOps/s	$\color{#d91a1a}-1.24\%$
test_step_mdp_speed[False-False-False-False-False]	44.1710μs	23.6196μs	42.3377 KOps/s	42.5639 KOps/s	$\color{#d91a1a}-0.53\%$
test_values[generalized_advantage_estimate-True-True]	10.5029ms	10.3290ms	96.8151 Ops/s	93.3396 Ops/s	$\color{#35bf28}+3.72\%$
test_values[vec_generalized_advantage_estimate-True-True]	15.3451ms	11.0355ms	90.6166 Ops/s	89.9568 Ops/s	$\color{#35bf28}+0.73\%$
test_values[td0_return_estimate-False-False]	0.2332ms	0.1280ms	7.8132 KOps/s	7.7059 KOps/s	$\color{#35bf28}+1.39\%$
test_values[td1_return_estimate-False-False]	28.4469ms	27.9647ms	35.7594 Ops/s	34.5471 Ops/s	$\color{#35bf28}+3.51\%$
test_values[vec_td1_return_estimate-False-False]	11.4077ms	11.0635ms	90.3873 Ops/s	90.0257 Ops/s	$\color{#35bf28}+0.40\%$
test_values[td_lambda_return_estimate-True-False]	42.6785ms	42.0295ms	23.7928 Ops/s	22.8318 Ops/s	$\color{#35bf28}+4.21\%$
test_values[vec_td_lambda_return_estimate-True-False]	13.1128ms	11.1429ms	89.7435 Ops/s	89.2701 Ops/s	$\color{#35bf28}+0.53\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	9.0441ms	8.9371ms	111.8934 Ops/s	108.6800 Ops/s	$\color{#35bf28}+2.96\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	1.6697ms	1.4878ms	672.1385 Ops/s	639.8322 Ops/s	$\textbf{\color{#35bf28}+5.05\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.5606ms	0.4206ms	2.3776 KOps/s	2.3577 KOps/s	$\color{#35bf28}+0.84\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	19.2714ms	18.6490ms	53.6221 Ops/s	39.4625 Ops/s	$\textbf{\color{#35bf28}+35.88\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	2.1022ms	1.7166ms	582.5549 Ops/s	581.9103 Ops/s	$\color{#35bf28}+0.11\%$
test_dqn_speed[False-None]	1.5544ms	1.4120ms	708.2337 Ops/s	684.7909 Ops/s	$\color{#35bf28}+3.42\%$
test_dqn_speed[False-backward]	2.0036ms	1.9344ms	516.9693 Ops/s	506.6951 Ops/s	$\color{#35bf28}+2.03\%$
test_dqn_speed[True-None]	0.7564ms	0.5243ms	1.9074 KOps/s	1.8829 KOps/s	$\color{#35bf28}+1.30\%$
test_dqn_speed[True-backward]	1.0057ms	0.9731ms	1.0276 KOps/s	884.1079 Ops/s	$\textbf{\color{#35bf28}+16.23\%}$
test_dqn_speed[reduce-overhead-None]	0.8997ms	0.5155ms	1.9397 KOps/s	1.8723 KOps/s	$\color{#35bf28}+3.60\%$
test_dqn_speed[reduce-overhead-backward]	1.0793ms	0.9606ms	1.0410 KOps/s	921.0842 Ops/s	$\textbf{\color{#35bf28}+13.02\%}$
test_ddpg_speed[False-None]	3.1778ms	2.8933ms	345.6241 Ops/s	341.6834 Ops/s	$\color{#35bf28}+1.15\%$
test_ddpg_speed[False-backward]	4.2924ms	4.1178ms	242.8509 Ops/s	240.1824 Ops/s	$\color{#35bf28}+1.11\%$
test_ddpg_speed[True-None]	1.7882ms	1.4028ms	712.8628 Ops/s	701.3062 Ops/s	$\color{#35bf28}+1.65\%$
test_ddpg_speed[True-backward]	2.4278ms	2.3803ms	420.1200 Ops/s	380.5313 Ops/s	$\textbf{\color{#35bf28}+10.40\%}$
test_ddpg_speed[reduce-overhead-None]	1.8020ms	1.3938ms	717.4714 Ops/s	707.5048 Ops/s	$\color{#35bf28}+1.41\%$
test_ddpg_speed[reduce-overhead-backward]	2.4388ms	2.3751ms	421.0435 Ops/s	408.2908 Ops/s	$\color{#35bf28}+3.12\%$
test_sac_speed[False-None]	8.3577ms	7.9336ms	126.0461 Ops/s	125.2785 Ops/s	$\color{#35bf28}+0.61\%$
test_sac_speed[False-backward]	12.2461ms	11.2685ms	88.7433 Ops/s	88.7611 Ops/s	$\color{#d91a1a}-0.02\%$
test_sac_speed[True-None]	2.4855ms	2.1122ms	473.4468 Ops/s	470.0719 Ops/s	$\color{#35bf28}+0.72\%$
test_sac_speed[True-backward]	4.1397ms	4.0421ms	247.3990 Ops/s	239.6330 Ops/s	$\color{#35bf28}+3.24\%$
test_sac_speed[reduce-overhead-None]	2.3170ms	2.1101ms	473.9164 Ops/s	453.0067 Ops/s	$\color{#35bf28}+4.62\%$
test_sac_speed[reduce-overhead-backward]	4.2068ms	4.0850ms	244.8004 Ops/s	232.3825 Ops/s	$\textbf{\color{#35bf28}+5.34\%}$
test_redq_speed[False-None]	11.4749ms	10.3773ms	96.3644 Ops/s	93.8362 Ops/s	$\color{#35bf28}+2.69\%$
test_redq_speed[False-backward]	18.8353ms	17.9138ms	55.8230 Ops/s	55.1241 Ops/s	$\color{#35bf28}+1.27\%$
test_redq_speed[True-None]	4.6221ms	4.3413ms	230.3467 Ops/s	223.4990 Ops/s	$\color{#35bf28}+3.06\%$
test_redq_speed[True-backward]	9.9940ms	9.7636ms	102.4213 Ops/s	102.0932 Ops/s	$\color{#35bf28}+0.32\%$
test_redq_speed[reduce-overhead-None]	4.5659ms	4.3029ms	232.3991 Ops/s	231.1094 Ops/s	$\color{#35bf28}+0.56\%$
test_redq_speed[reduce-overhead-backward]	10.1841ms	9.9556ms	100.4461 Ops/s	100.8893 Ops/s	$\color{#d91a1a}-0.44\%$
test_redq_deprec_speed[False-None]	11.3585ms	10.9710ms	91.1494 Ops/s	88.1021 Ops/s	$\color{#35bf28}+3.46\%$
test_redq_deprec_speed[False-backward]	16.5315ms	15.8039ms	63.2755 Ops/s	61.6053 Ops/s	$\color{#35bf28}+2.71\%$
test_redq_deprec_speed[True-None]	5.2336ms	3.6954ms	270.6043 Ops/s	261.1018 Ops/s	$\color{#35bf28}+3.64\%$
test_redq_deprec_speed[True-backward]	7.5907ms	7.4034ms	135.0724 Ops/s	123.9183 Ops/s	$\textbf{\color{#35bf28}+9.00\%}$
test_redq_deprec_speed[reduce-overhead-None]	3.7767ms	3.5361ms	282.7988 Ops/s	281.8416 Ops/s	$\color{#35bf28}+0.34\%$
test_redq_deprec_speed[reduce-overhead-backward]	7.6417ms	7.3454ms	136.1399 Ops/s	132.3752 Ops/s	$\color{#35bf28}+2.84\%$
test_td3_speed[False-None]	8.2385ms	8.0117ms	124.8173 Ops/s	124.8388 Ops/s	$\color{#d91a1a}-0.02\%$
test_td3_speed[False-backward]	11.3973ms	10.9158ms	91.6105 Ops/s	91.5797 Ops/s	$\color{#35bf28}+0.03\%$
test_td3_speed[True-None]	1.9232ms	1.8145ms	551.1265 Ops/s	546.4664 Ops/s	$\color{#35bf28}+0.85\%$
test_td3_speed[True-backward]	3.7688ms	3.6230ms	276.0124 Ops/s	274.9882 Ops/s	$\color{#35bf28}+0.37\%$
test_td3_speed[reduce-overhead-None]	2.0146ms	1.7766ms	562.8760 Ops/s	555.8553 Ops/s	$\color{#35bf28}+1.26\%$
test_td3_speed[reduce-overhead-backward]	3.7449ms	3.6090ms	277.0863 Ops/s	259.6431 Ops/s	$\textbf{\color{#35bf28}+6.72\%}$
test_cql_speed[False-None]	29.1193ms	26.2926ms	38.0335 Ops/s	37.6333 Ops/s	$\color{#35bf28}+1.06\%$
test_cql_speed[False-backward]	40.0655ms	35.9527ms	27.8143 Ops/s	27.9892 Ops/s	$\color{#d91a1a}-0.62\%$
test_cql_speed[True-None]	13.0688ms	12.3564ms	80.9294 Ops/s	79.4316 Ops/s	$\color{#35bf28}+1.89\%$
test_cql_speed[True-backward]	18.7553ms	18.1907ms	54.9730 Ops/s	53.8525 Ops/s	$\color{#35bf28}+2.08\%$
test_cql_speed[reduce-overhead-None]	12.9362ms	12.5771ms	79.5094 Ops/s	80.3769 Ops/s	$\color{#d91a1a}-1.08\%$
test_cql_speed[reduce-overhead-backward]	18.8051ms	18.4814ms	54.1084 Ops/s	54.2550 Ops/s	$\color{#d91a1a}-0.27\%$
test_a2c_speed[False-None]	5.8329ms	5.4525ms	183.4026 Ops/s	180.1550 Ops/s	$\color{#35bf28}+1.80\%$
test_a2c_speed[False-backward]	12.3090ms	11.9592ms	83.6178 Ops/s	81.6418 Ops/s	$\color{#35bf28}+2.42\%$
test_a2c_speed[True-None]	4.3329ms	3.7090ms	269.6167 Ops/s	262.3196 Ops/s	$\color{#35bf28}+2.78\%$
test_a2c_speed[True-backward]	8.9607ms	8.7688ms	114.0407 Ops/s	113.7829 Ops/s	$\color{#35bf28}+0.23\%$
test_a2c_speed[reduce-overhead-None]	5.2499ms	3.8149ms	262.1327 Ops/s	270.1140 Ops/s	$\color{#d91a1a}-2.95\%$
test_a2c_speed[reduce-overhead-backward]	9.1749ms	8.8107ms	113.4988 Ops/s	103.1476 Ops/s	$\textbf{\color{#35bf28}+10.04\%}$
test_ppo_speed[False-None]	6.2738ms	5.9004ms	169.4804 Ops/s	165.8667 Ops/s	$\color{#35bf28}+2.18\%$
test_ppo_speed[False-backward]	12.8452ms	12.5030ms	79.9808 Ops/s	78.0453 Ops/s	$\color{#35bf28}+2.48\%$
test_ppo_speed[True-None]	3.8399ms	3.6580ms	273.3736 Ops/s	252.0292 Ops/s	$\textbf{\color{#35bf28}+8.47\%}$
test_ppo_speed[True-backward]	8.7461ms	8.5593ms	116.8325 Ops/s	109.4793 Ops/s	$\textbf{\color{#35bf28}+6.72\%}$
test_ppo_speed[reduce-overhead-None]	4.0096ms	3.6180ms	276.3952 Ops/s	272.8653 Ops/s	$\color{#35bf28}+1.29\%$
test_ppo_speed[reduce-overhead-backward]	9.3245ms	8.7771ms	113.9326 Ops/s	97.5740 Ops/s	$\textbf{\color{#35bf28}+16.77\%}$
test_reinforce_speed[False-None]	5.3416ms	4.5828ms	218.2079 Ops/s	212.0853 Ops/s	$\color{#35bf28}+2.89\%$
test_reinforce_speed[False-backward]	7.7283ms	7.4528ms	134.1774 Ops/s	132.7362 Ops/s	$\color{#35bf28}+1.09\%$
test_reinforce_speed[True-None]	3.2164ms	2.8626ms	349.3336 Ops/s	340.6798 Ops/s	$\color{#35bf28}+2.54\%$
test_reinforce_speed[True-backward]	8.2864ms	7.8069ms	128.0915 Ops/s	124.1237 Ops/s	$\color{#35bf28}+3.20\%$
test_reinforce_speed[reduce-overhead-None]	3.2905ms	2.8432ms	351.7212 Ops/s	313.1162 Ops/s	$\textbf{\color{#35bf28}+12.33\%}$
test_reinforce_speed[reduce-overhead-backward]	8.5695ms	7.9880ms	125.1884 Ops/s	118.0755 Ops/s	$\textbf{\color{#35bf28}+6.02\%}$
test_iql_speed[False-None]	25.4012ms	20.4562ms	48.8849 Ops/s	48.8718 Ops/s	$\color{#35bf28}+0.03\%$
test_iql_speed[False-backward]	35.6982ms	30.7913ms	32.4767 Ops/s	32.5328 Ops/s	$\color{#d91a1a}-0.17\%$
test_iql_speed[True-None]	8.7708ms	8.4885ms	117.8062 Ops/s	116.4945 Ops/s	$\color{#35bf28}+1.13\%$
test_iql_speed[True-backward]	19.9784ms	17.2720ms	57.8971 Ops/s	58.7194 Ops/s	$\color{#d91a1a}-1.40\%$
test_iql_speed[reduce-overhead-None]	11.2490ms	8.6679ms	115.3688 Ops/s	115.5608 Ops/s	$\color{#d91a1a}-0.17\%$
test_iql_speed[reduce-overhead-backward]	17.6107ms	17.1400ms	58.3432 Ops/s	56.9141 Ops/s	$\color{#35bf28}+2.51\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	7.6431ms	6.0493ms	165.3091 Ops/s	166.3916 Ops/s	$\color{#d91a1a}-0.65\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.5548ms	0.2802ms	3.5690 KOps/s	2.7672 KOps/s	$\textbf{\color{#35bf28}+28.98\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5107ms	0.2603ms	3.8417 KOps/s	3.1641 KOps/s	$\textbf{\color{#35bf28}+21.41\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.0389ms	5.7885ms	172.7558 Ops/s	174.5875 Ops/s	$\color{#d91a1a}-1.05\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	2.0272ms	0.2737ms	3.6534 KOps/s	3.0364 KOps/s	$\textbf{\color{#35bf28}+20.32\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.4676ms	0.2559ms	3.9083 KOps/s	3.4819 KOps/s	$\textbf{\color{#35bf28}+12.25\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.5402ms	1.2571ms	795.4844 Ops/s	770.7105 Ops/s	$\color{#35bf28}+3.21\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.5044ms	1.1758ms	850.5208 Ops/s	828.2899 Ops/s	$\color{#35bf28}+2.68\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.1483ms	5.9218ms	168.8675 Ops/s	169.0334 Ops/s	$\color{#d91a1a}-0.10\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.8818ms	0.4380ms	2.2830 KOps/s	2.1190 KOps/s	$\textbf{\color{#35bf28}+7.74\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.6628ms	0.4121ms	2.4266 KOps/s	2.4207 KOps/s	$\color{#35bf28}+0.25\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	5.9161ms	5.8088ms	172.1532 Ops/s	173.0830 Ops/s	$\color{#d91a1a}-0.54\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.6533ms	0.2766ms	3.6152 KOps/s	2.5068 KOps/s	$\textbf{\color{#35bf28}+44.22\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6940ms	0.2627ms	3.8062 KOps/s	2.6121 KOps/s	$\textbf{\color{#35bf28}+45.71\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.2696ms	5.7402ms	174.2104 Ops/s	174.4882 Ops/s	$\color{#d91a1a}-0.16\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.9493ms	0.3521ms	2.8398 KOps/s	3.1899 KOps/s	$\textbf{\color{#d91a1a}-10.98\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.5669ms	0.3494ms	2.8624 KOps/s	3.8457 KOps/s	$\textbf{\color{#d91a1a}-25.57\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	9.7054ms	6.0570ms	165.0981 Ops/s	169.0796 Ops/s	$\color{#d91a1a}-2.35\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	2.1321ms	0.4973ms	2.0107 KOps/s	1.8336 KOps/s	$\textbf{\color{#35bf28}+9.66\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.7627ms	0.4807ms	2.0802 KOps/s	2.1511 KOps/s	$\color{#d91a1a}-3.30\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.5437s	15.8640ms	63.0357 Ops/s	193.2038 Ops/s	$\textbf{\color{#d91a1a}-67.37\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	2.2926ms	1.4006ms	713.9831 Ops/s	439.0700 Ops/s	$\textbf{\color{#35bf28}+62.61\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	2.0345ms	1.0476ms	954.5852 Ops/s	847.8289 Ops/s	$\textbf{\color{#35bf28}+12.59\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	7.3742ms	5.1233ms	195.1856 Ops/s	55.7809 Ops/s	$\textbf{\color{#35bf28}+249.91\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	8.3135ms	2.0467ms	488.5808 Ops/s	481.3583 Ops/s	$\color{#35bf28}+1.50\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	7.7618ms	1.2135ms	824.0896 Ops/s	914.3367 Ops/s	$\textbf{\color{#d91a1a}-9.87\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.4742s	14.6974ms	68.0394 Ops/s	183.1399 Ops/s	$\textbf{\color{#d91a1a}-62.85\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	11.1457ms	2.1305ms	469.3658 Ops/s	457.5457 Ops/s	$\color{#35bf28}+2.58\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	1.1598ms	1.0109ms	989.2153 Ops/s	719.1809 Ops/s	$\textbf{\color{#35bf28}+37.55\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True]	36.3005ms	33.2853ms	30.0433 Ops/s	29.4339 Ops/s	$\color{#35bf28}+2.07\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False]	19.0231ms	17.4079ms	57.4453 Ops/s	55.3105 Ops/s	$\color{#35bf28}+3.86\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True]	37.4114ms	34.3573ms	29.1059 Ops/s	27.8594 Ops/s	$\color{#35bf28}+4.47\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False]	19.4500ms	17.6962ms	56.5093 Ops/s	54.3211 Ops/s	$\color{#35bf28}+4.03\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True]	38.3818ms	36.0063ms	27.7729 Ops/s	26.8934 Ops/s	$\color{#35bf28}+3.27\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False]	20.3257ms	18.8587ms	53.0259 Ops/s	50.2305 Ops/s	$\textbf{\color{#35bf28}+5.57\%}$

[ghstack-poisoned]

ghstack-source-id: 8ba7752 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: ae4c9e7 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: 03ac637 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: a5e6c7e Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: 2e0ec49 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: 6cae8b8 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: a3a6a29 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: 16088a5 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: c321cb1 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: 03ab538 Pull-Request: #3211

[ghstack-poisoned]

ghstack-source-id: 346c750 Pull-Request: #3211

[ghstack-poisoned]

Update

0501f2f

[ghstack-poisoned]

meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 18, 2025

vmoens added a commit that referenced this pull request Oct 18, 2025

[Quality] Fix flaky test

f262594

ghstack-source-id: 839143f Pull-Request: #3211

Update

e6d107c

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 18, 2025

[Quality] Fix flaky test

1d6bc27

ghstack-source-id: e41e8b1 Pull-Request: #3211

Update

16b517f

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 19, 2025

[Quality] Fix flaky test

da9cee1

ghstack-source-id: f9b82b5 Pull-Request: #3211

vmoens added a commit that referenced this pull request Oct 19, 2025

[Quality] Fix flaky test

e5bc0c9

ghstack-source-id: f9b82b5 Pull-Request: #3211

vmoens added a commit that referenced this pull request Oct 19, 2025

[Quality] Fix flaky test

82b0c7f

ghstack-source-id: f9b82b5 Pull-Request: #3211

vmoens added a commit that referenced this pull request Oct 19, 2025

[Quality] Fix flaky test

b826048

ghstack-source-id: f9b82b5 Pull-Request: #3211

Update

af5e823

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 20, 2025

[Quality] Fix flaky test

0f66246

ghstack-source-id: fa649fd Pull-Request: #3211

Update

f36ab08

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 20, 2025

[Quality] Fix flaky test

ec91079

ghstack-source-id: ab51147 Pull-Request: #3211

vmoens added the quality code quality label Oct 20, 2025

Update

e317f21

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 20, 2025

[Quality] Fix flaky test

0b060ab

ghstack-source-id: 609aeb2 Pull-Request: #3211

vmoens mentioned this pull request Oct 20, 2025

[CI] Fix benchmarks for LLMs #3212

Merged

Update

34ea977

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 20, 2025

[Quality] Fix flaky test

d308973

ghstack-source-id: 2b57e12 Pull-Request: #3211

Update

b54405f

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 20, 2025

[Quality] Fix flaky test

df60424

ghstack-source-id: 8ba7752 Pull-Request: #3211

vmoens added a commit that referenced this pull request Oct 20, 2025

[Quality] Fix flaky test

65e230a

ghstack-source-id: 8ba7752 Pull-Request: #3211

Update

fbe6688

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 20, 2025

[Quality] Fix flaky test

0bfbe0a

ghstack-source-id: ae4c9e7 Pull-Request: #3211

Update

5d4d786

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 21, 2025

[Quality] Fix flaky test

1ea0d8f

ghstack-source-id: 03ac637 Pull-Request: #3211

Update

f6cc6fd

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 21, 2025

[Quality] Fix flaky test

b2ea3fe

ghstack-source-id: a5e6c7e Pull-Request: #3211

Update

20e404e

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 22, 2025

[Quality] Fix flaky test

615da9b

ghstack-source-id: 2e0ec49 Pull-Request: #3211

Update

2e9e545

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 22, 2025

[Quality] Fix flaky test

7ee64fa

ghstack-source-id: 6cae8b8 Pull-Request: #3211

Update

fce1f16

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 22, 2025

[Quality] Fix flaky test

b1ec52f

ghstack-source-id: a3a6a29 Pull-Request: #3211

This was referenced Oct 22, 2025

[CI] LLM tests integration #3216

Open

[Feature] Composite specs can create named tensors with 'zero' and 'rand' (#3214) #3217

Open

Update

548c48e

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 22, 2025

[Quality] Fix flaky test

8efd281

ghstack-source-id: 16088a5 Pull-Request: #3211

Update

4620705

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 22, 2025

[Quality] Fix flaky test

a2e143f

ghstack-source-id: c321cb1 Pull-Request: #3211

Update

c5ea7f7

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 22, 2025

[Quality] Fix flaky test

a238332

ghstack-source-id: 03ab538 Pull-Request: #3211

Update

7d82457

[ghstack-poisoned]

vmoens added a commit that referenced this pull request Oct 23, 2025

[Quality] Fix flaky test

15144b6

ghstack-source-id: 346c750 Pull-Request: #3211

vmoens added 3 commits October 22, 2025 17:43

Update

2100182

[ghstack-poisoned]

Update

952b7e7

[ghstack-poisoned]

Update

5c2d8a8

[ghstack-poisoned]

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Quality] Fix flaky test #3211

[Quality] Fix flaky test #3211

vmoens commented Oct 18, 2025 •

edited

Loading

Uh oh!

pytorch-bot bot commented Oct 18, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Oct 20, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

[Quality] Fix flaky test #3211

Are you sure you want to change the base?

[Quality] Fix flaky test #3211

Conversation

vmoens commented Oct 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Oct 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3211

❌ 7 New Failures, 1 Cancelled Job, 3 Unrelated Failures

Uh oh!

github-actions bot commented Oct 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

$\color{#D29922}\textsf{\Large&amp;#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}29$. Worsened: $\large\color{#d91a1a}5$.

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

vmoens commented Oct 18, 2025 •

edited

Loading

pytorch-bot bot commented Oct 18, 2025 •

edited

Loading

github-actions bot commented Oct 20, 2025 •

edited

Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests