Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Versioning] Add python 3.12 to setup.py #2282

Merged
merged 11 commits into from
Jul 28, 2024
Merged

[Versioning] Add python 3.12 to setup.py #2282

merged 11 commits into from
Jul 28, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Jul 9, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jul 9, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2282

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Pending, 1 Unrelated Failure

As of commit 5aba2b6 with merge base 474e837 (image):

NEW FAILURE - The following job has failed:

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 9, 2024
@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Jul 9, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Jul 9, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}7$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 61.7742ms 61.1698ms 16.3479 Ops/s 16.7302 Ops/s $\color{#d91a1a}-2.28\%$
test_sync 40.1115ms 34.0899ms 29.3342 Ops/s 30.5006 Ops/s $\color{#d91a1a}-3.82\%$
test_async 61.9108ms 31.8788ms 31.3688 Ops/s 31.9749 Ops/s $\color{#d91a1a}-1.90\%$
test_simple 0.5238s 0.4357s 2.2950 Ops/s 2.4339 Ops/s $\textbf{\color{#d91a1a}-5.71\%}$
test_transformed 0.6808s 0.6033s 1.6575 Ops/s 1.6699 Ops/s $\color{#d91a1a}-0.74\%$
test_serial 1.4223s 1.3353s 0.7489 Ops/s 0.7551 Ops/s $\color{#d91a1a}-0.82\%$
test_parallel 1.2166s 1.1387s 0.8782 Ops/s 0.8817 Ops/s $\color{#d91a1a}-0.40\%$
test_step_mdp_speed[True-True-True-True-True] 0.2801ms 24.4019μs 40.9805 KOps/s 41.2463 KOps/s $\color{#d91a1a}-0.64\%$
test_step_mdp_speed[True-True-True-True-False] 45.4960μs 14.2926μs 69.9665 KOps/s 70.5477 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[True-True-True-False-True] 44.4830μs 14.1163μs 70.8400 KOps/s 72.1634 KOps/s $\color{#d91a1a}-1.83\%$
test_step_mdp_speed[True-True-True-False-False] 36.8590μs 8.1768μs 122.2975 KOps/s 122.9659 KOps/s $\color{#d91a1a}-0.54\%$
test_step_mdp_speed[True-True-False-True-True] 72.3760μs 25.9057μs 38.6015 KOps/s 39.1764 KOps/s $\color{#d91a1a}-1.47\%$
test_step_mdp_speed[True-True-False-True-False] 70.0110μs 15.5520μs 64.3005 KOps/s 63.7120 KOps/s $\color{#35bf28}+0.92\%$
test_step_mdp_speed[True-True-False-False-True] 55.9350μs 15.6120μs 64.0531 KOps/s 65.0488 KOps/s $\color{#d91a1a}-1.53\%$
test_step_mdp_speed[True-True-False-False-False] 71.1740μs 9.6744μs 103.3654 KOps/s 104.6624 KOps/s $\color{#d91a1a}-1.24\%$
test_step_mdp_speed[True-False-True-True-True] 72.0950μs 27.5761μs 36.2633 KOps/s 36.7270 KOps/s $\color{#d91a1a}-1.26\%$
test_step_mdp_speed[True-False-True-True-False] 55.8650μs 17.2091μs 58.1087 KOps/s 58.0311 KOps/s $\color{#35bf28}+0.13\%$
test_step_mdp_speed[True-False-True-False-True] 51.6970μs 15.5713μs 64.2209 KOps/s 65.2582 KOps/s $\color{#d91a1a}-1.59\%$
test_step_mdp_speed[True-False-True-False-False] 57.9890μs 9.6392μs 103.7427 KOps/s 105.1383 KOps/s $\color{#d91a1a}-1.33\%$
test_step_mdp_speed[True-False-False-True-True] 72.2960μs 28.8991μs 34.6031 KOps/s 34.8112 KOps/s $\color{#d91a1a}-0.60\%$
test_step_mdp_speed[True-False-False-True-False] 66.9350μs 18.6801μs 53.5329 KOps/s 53.9786 KOps/s $\color{#d91a1a}-0.83\%$
test_step_mdp_speed[True-False-False-False-True] 64.8120μs 17.0530μs 58.6406 KOps/s 60.4475 KOps/s $\color{#d91a1a}-2.99\%$
test_step_mdp_speed[True-False-False-False-False] 43.5820μs 11.0127μs 90.8041 KOps/s 91.9888 KOps/s $\color{#d91a1a}-1.29\%$
test_step_mdp_speed[False-True-True-True-True] 66.3650μs 27.5416μs 36.3087 KOps/s 36.6463 KOps/s $\color{#d91a1a}-0.92\%$
test_step_mdp_speed[False-True-True-True-False] 60.0820μs 17.1090μs 58.4488 KOps/s 57.9362 KOps/s $\color{#35bf28}+0.88\%$
test_step_mdp_speed[False-True-True-False-True] 0.1138ms 18.5650μs 53.8648 KOps/s 56.5745 KOps/s $\color{#d91a1a}-4.79\%$
test_step_mdp_speed[False-True-True-False-False] 48.9620μs 10.9695μs 91.1622 KOps/s 93.6100 KOps/s $\color{#d91a1a}-2.61\%$
test_step_mdp_speed[False-True-False-True-True] 84.4580μs 28.9912μs 34.4932 KOps/s 35.1361 KOps/s $\color{#d91a1a}-1.83\%$
test_step_mdp_speed[False-True-False-True-False] 77.4050μs 18.5346μs 53.9530 KOps/s 54.4004 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[False-True-False-False-True] 63.7200μs 19.7559μs 50.6177 KOps/s 52.5037 KOps/s $\color{#d91a1a}-3.59\%$
test_step_mdp_speed[False-True-False-False-False] 56.0660μs 12.3042μs 81.2728 KOps/s 82.9155 KOps/s $\color{#d91a1a}-1.98\%$
test_step_mdp_speed[False-False-True-True-True] 3.6287ms 30.5268μs 32.7581 KOps/s 33.0357 KOps/s $\color{#d91a1a}-0.84\%$
test_step_mdp_speed[False-False-True-True-False] 65.1220μs 20.1393μs 49.6541 KOps/s 50.1224 KOps/s $\color{#d91a1a}-0.93\%$
test_step_mdp_speed[False-False-True-False-True] 61.7060μs 19.6597μs 50.8655 KOps/s 52.4683 KOps/s $\color{#d91a1a}-3.05\%$
test_step_mdp_speed[False-False-True-False-False] 53.1390μs 12.3218μs 81.1570 KOps/s 81.5778 KOps/s $\color{#d91a1a}-0.52\%$
test_step_mdp_speed[False-False-False-True-True] 84.4490μs 31.4163μs 31.8306 KOps/s 31.8848 KOps/s $\color{#d91a1a}-0.17\%$
test_step_mdp_speed[False-False-False-True-False] 93.4760μs 21.1882μs 47.1960 KOps/s 46.1748 KOps/s $\color{#35bf28}+2.21\%$
test_step_mdp_speed[False-False-False-False-True] 65.8940μs 20.7536μs 48.1844 KOps/s 48.9634 KOps/s $\color{#d91a1a}-1.59\%$
test_step_mdp_speed[False-False-False-False-False] 52.4890μs 13.5078μs 74.0313 KOps/s 74.5249 KOps/s $\color{#d91a1a}-0.66\%$
test_values[generalized_advantage_estimate-True-True] 10.3357ms 10.0956ms 99.0532 Ops/s 102.9572 Ops/s $\color{#d91a1a}-3.79\%$
test_values[vec_generalized_advantage_estimate-True-True] 38.4322ms 35.8150ms 27.9212 Ops/s 29.6194 Ops/s $\textbf{\color{#d91a1a}-5.73\%}$
test_values[td0_return_estimate-False-False] 0.2478ms 0.1993ms 5.0173 KOps/s 5.0476 KOps/s $\color{#d91a1a}-0.60\%$
test_values[td1_return_estimate-False-False] 36.2268ms 24.9428ms 40.0918 Ops/s 41.2689 Ops/s $\color{#d91a1a}-2.85\%$
test_values[vec_td1_return_estimate-False-False] 37.9533ms 35.8357ms 27.9052 Ops/s 29.7081 Ops/s $\textbf{\color{#d91a1a}-6.07\%}$
test_values[td_lambda_return_estimate-True-False] 39.7429ms 35.8490ms 27.8948 Ops/s 28.7506 Ops/s $\color{#d91a1a}-2.98\%$
test_values[vec_td_lambda_return_estimate-True-False] 43.0306ms 36.3717ms 27.4939 Ops/s 29.6883 Ops/s $\textbf{\color{#d91a1a}-7.39\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.7427ms 8.5186ms 117.3896 Ops/s 122.5353 Ops/s $\color{#d91a1a}-4.20\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.2375ms 1.9033ms 525.4026 Ops/s 496.5753 Ops/s $\textbf{\color{#35bf28}+5.81\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5926ms 0.3682ms 2.7160 KOps/s 2.8082 KOps/s $\color{#d91a1a}-3.29\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 49.9815ms 47.1686ms 21.2005 Ops/s 22.1689 Ops/s $\color{#d91a1a}-4.37\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 4.1964ms 3.1095ms 321.5926 Ops/s 318.6155 Ops/s $\color{#35bf28}+0.93\%$
test_dqn_speed 1.7295ms 1.3234ms 755.6472 Ops/s 757.3971 Ops/s $\color{#d91a1a}-0.23\%$
test_ddpg_speed 3.4640ms 2.7715ms 360.8161 Ops/s 359.6947 Ops/s $\color{#35bf28}+0.31\%$
test_sac_speed 10.1745ms 8.5835ms 116.5025 Ops/s 114.3137 Ops/s $\color{#35bf28}+1.91\%$
test_redq_speed 14.4362ms 13.5032ms 74.0565 Ops/s 71.9017 Ops/s $\color{#35bf28}+3.00\%$
test_redq_deprec_speed 15.4725ms 14.0024ms 71.4162 Ops/s 69.0355 Ops/s $\color{#35bf28}+3.45\%$
test_td3_speed 8.9492ms 8.5299ms 117.2341 Ops/s 116.1136 Ops/s $\color{#35bf28}+0.96\%$
test_cql_speed 42.7338ms 37.4014ms 26.7370 Ops/s 26.3412 Ops/s $\color{#35bf28}+1.50\%$
test_a2c_speed 8.9719ms 7.8799ms 126.9046 Ops/s 125.1961 Ops/s $\color{#35bf28}+1.36\%$
test_ppo_speed 9.0261ms 8.2603ms 121.0608 Ops/s 119.5879 Ops/s $\color{#35bf28}+1.23\%$
test_reinforce_speed 8.1029ms 6.8920ms 145.0950 Ops/s 142.7721 Ops/s $\color{#35bf28}+1.63\%$
test_iql_speed 34.8745ms 33.0546ms 30.2529 Ops/s 29.1315 Ops/s $\color{#35bf28}+3.85\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.4840ms 5.2731ms 189.6418 Ops/s 185.6949 Ops/s $\color{#35bf28}+2.13\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9332ms 0.4998ms 2.0008 KOps/s 1.9689 KOps/s $\color{#35bf28}+1.62\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.8581ms 0.4725ms 2.1162 KOps/s 2.1070 KOps/s $\color{#35bf28}+0.44\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 8.9504ms 5.2858ms 189.1852 Ops/s 185.7874 Ops/s $\color{#35bf28}+1.83\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8178ms 0.4957ms 2.0173 KOps/s 1.9753 KOps/s $\color{#35bf28}+2.13\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7665ms 0.4666ms 2.1432 KOps/s 2.0988 KOps/s $\color{#35bf28}+2.11\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.8751ms 1.7154ms 582.9584 Ops/s 583.5743 Ops/s $\color{#d91a1a}-0.11\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.4984ms 1.6388ms 610.2130 Ops/s 614.4873 Ops/s $\color{#d91a1a}-0.70\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.5527ms 5.2087ms 191.9847 Ops/s 173.4835 Ops/s $\textbf{\color{#35bf28}+10.66\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0476ms 0.6411ms 1.5598 KOps/s 1.5403 KOps/s $\color{#35bf28}+1.26\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.1845ms 0.6092ms 1.6415 KOps/s 1.6076 KOps/s $\color{#35bf28}+2.11\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 8.2382ms 5.1705ms 193.4051 Ops/s 180.2535 Ops/s $\textbf{\color{#35bf28}+7.30\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.2894ms 0.4955ms 2.0181 KOps/s 1.3953 KOps/s $\textbf{\color{#35bf28}+44.64\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7872ms 0.4765ms 2.0985 KOps/s 2.0512 KOps/s $\color{#35bf28}+2.30\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 8.1044ms 5.2561ms 190.2558 Ops/s 179.4971 Ops/s $\textbf{\color{#35bf28}+5.99\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6143ms 0.4934ms 2.0266 KOps/s 1.9799 KOps/s $\color{#35bf28}+2.36\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7583ms 0.4702ms 2.1267 KOps/s 2.1077 KOps/s $\color{#35bf28}+0.90\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.7206ms 5.3572ms 186.6652 Ops/s 178.3927 Ops/s $\color{#35bf28}+4.64\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9499ms 0.6463ms 1.5473 KOps/s 1.5383 KOps/s $\color{#35bf28}+0.58\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.1358s 0.8094ms 1.2355 KOps/s 1.5966 KOps/s $\textbf{\color{#d91a1a}-22.62\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1240s 6.2419ms 160.2084 Ops/s 147.8321 Ops/s $\textbf{\color{#35bf28}+8.37\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.8872ms 13.8589ms 72.1557 Ops/s 73.2874 Ops/s $\color{#d91a1a}-1.54\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.8901ms 1.1691ms 855.3542 Ops/s 893.1496 Ops/s $\color{#d91a1a}-4.23\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1274s 6.3629ms 157.1621 Ops/s 156.8428 Ops/s $\color{#35bf28}+0.20\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 18.3043ms 13.8085ms 72.4191 Ops/s 73.8042 Ops/s $\color{#d91a1a}-1.88\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.6590ms 1.1218ms 891.4084 Ops/s 888.8051 Ops/s $\color{#35bf28}+0.29\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1236s 8.7666ms 114.0690 Ops/s 107.5859 Ops/s $\textbf{\color{#35bf28}+6.03\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.9992ms 13.8506ms 72.1989 Ops/s 72.0670 Ops/s $\color{#35bf28}+0.18\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.2776ms 1.3200ms 757.5786 Ops/s 730.5870 Ops/s $\color{#35bf28}+3.69\%$
@github-actions GitHub Actions
Copy link

github-actions bot commented Jul 9, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1095s 0.1093s 9.1525 Ops/s 8.2767 Ops/s $\textbf{\color{#35bf28}+10.58\%}$
test_sync 95.5903ms 95.0392ms 10.5220 Ops/s 10.4972 Ops/s $\color{#35bf28}+0.24\%$
test_async 0.1788s 90.9437ms 10.9958 Ops/s 11.0508 Ops/s $\color{#d91a1a}-0.50\%$
test_single_pixels 0.1195s 0.1191s 8.3962 Ops/s 8.2666 Ops/s $\color{#35bf28}+1.57\%$
test_sync_pixels 76.9080ms 75.2217ms 13.2940 Ops/s 13.3353 Ops/s $\color{#d91a1a}-0.31\%$
test_async_pixels 0.1414s 70.6318ms 14.1579 Ops/s 14.2295 Ops/s $\color{#d91a1a}-0.50\%$
test_simple 0.7928s 0.7874s 1.2700 Ops/s 1.2250 Ops/s $\color{#35bf28}+3.68\%$
test_transformed 1.1295s 1.0498s 0.9526 Ops/s 0.9644 Ops/s $\color{#d91a1a}-1.23\%$
test_serial 2.3456s 2.2709s 0.4404 Ops/s 0.4333 Ops/s $\color{#35bf28}+1.63\%$
test_parallel 2.0377s 1.9779s 0.5056 Ops/s 0.5026 Ops/s $\color{#35bf28}+0.59\%$
test_step_mdp_speed[True-True-True-True-True] 0.1004ms 36.7200μs 27.2331 KOps/s 27.4626 KOps/s $\color{#d91a1a}-0.84\%$
test_step_mdp_speed[True-True-True-True-False] 53.0720μs 20.6838μs 48.3471 KOps/s 47.4844 KOps/s $\color{#35bf28}+1.82\%$
test_step_mdp_speed[True-True-True-False-True] 56.2800μs 20.5696μs 48.6153 KOps/s 48.7883 KOps/s $\color{#d91a1a}-0.35\%$
test_step_mdp_speed[True-True-True-False-False] 78.7920μs 11.7049μs 85.4342 KOps/s 84.2388 KOps/s $\color{#35bf28}+1.42\%$
test_step_mdp_speed[True-True-False-True-True] 81.0710μs 38.3159μs 26.0988 KOps/s 25.5553 KOps/s $\color{#35bf28}+2.13\%$
test_step_mdp_speed[True-True-False-True-False] 51.3510μs 22.9342μs 43.6030 KOps/s 42.9274 KOps/s $\color{#35bf28}+1.57\%$
test_step_mdp_speed[True-True-False-False-True] 51.4110μs 22.5774μs 44.2922 KOps/s 43.5768 KOps/s $\color{#35bf28}+1.64\%$
test_step_mdp_speed[True-True-False-False-False] 36.5920μs 13.8883μs 72.0033 KOps/s 70.6380 KOps/s $\color{#35bf28}+1.93\%$
test_step_mdp_speed[True-False-True-True-True] 76.8920μs 40.6475μs 24.6018 KOps/s 24.2786 KOps/s $\color{#35bf28}+1.33\%$
test_step_mdp_speed[True-False-True-True-False] 54.8420μs 25.1690μs 39.7314 KOps/s 39.2145 KOps/s $\color{#35bf28}+1.32\%$
test_step_mdp_speed[True-False-True-False-True] 50.4810μs 22.5334μs 44.3785 KOps/s 43.6495 KOps/s $\color{#35bf28}+1.67\%$
test_step_mdp_speed[True-False-True-False-False] 76.0420μs 13.7896μs 72.5185 KOps/s 70.3756 KOps/s $\color{#35bf28}+3.04\%$
test_step_mdp_speed[True-False-False-True-True] 79.6830μs 41.8617μs 23.8882 KOps/s 22.9527 KOps/s $\color{#35bf28}+4.08\%$
test_step_mdp_speed[True-False-False-True-False] 88.8110μs 26.7834μs 37.3366 KOps/s 35.8934 KOps/s $\color{#35bf28}+4.02\%$
test_step_mdp_speed[True-False-False-False-True] 55.9200μs 24.7890μs 40.3404 KOps/s 40.1286 KOps/s $\color{#35bf28}+0.53\%$
test_step_mdp_speed[True-False-False-False-False] 40.3010μs 15.9221μs 62.8059 KOps/s 61.3230 KOps/s $\color{#35bf28}+2.42\%$
test_step_mdp_speed[False-True-True-True-True] 80.4720μs 40.3119μs 24.8066 KOps/s 24.3413 KOps/s $\color{#35bf28}+1.91\%$
test_step_mdp_speed[False-True-True-True-False] 58.7520μs 24.9920μs 40.0128 KOps/s 38.9376 KOps/s $\color{#35bf28}+2.76\%$
test_step_mdp_speed[False-True-True-False-True] 59.0900μs 27.0857μs 36.9198 KOps/s 36.2802 KOps/s $\color{#35bf28}+1.76\%$
test_step_mdp_speed[False-True-True-False-False] 41.5200μs 15.7642μs 63.4348 KOps/s 61.9324 KOps/s $\color{#35bf28}+2.43\%$
test_step_mdp_speed[False-True-False-True-True] 77.3120μs 42.6858μs 23.4270 KOps/s 23.0972 KOps/s $\color{#35bf28}+1.43\%$
test_step_mdp_speed[False-True-False-True-False] 55.7620μs 26.9833μs 37.0599 KOps/s 35.9313 KOps/s $\color{#35bf28}+3.14\%$
test_step_mdp_speed[False-True-False-False-True] 59.6010μs 28.8408μs 34.6731 KOps/s 33.7705 KOps/s $\color{#35bf28}+2.67\%$
test_step_mdp_speed[False-True-False-False-False] 43.9410μs 17.8332μs 56.0752 KOps/s 54.3210 KOps/s $\color{#35bf28}+3.23\%$
test_step_mdp_speed[False-False-True-True-True] 3.8284ms 45.1687μs 22.1392 KOps/s 21.6586 KOps/s $\color{#35bf28}+2.22\%$
test_step_mdp_speed[False-False-True-True-False] 60.0020μs 29.5728μs 33.8149 KOps/s 33.1287 KOps/s $\color{#35bf28}+2.07\%$
test_step_mdp_speed[False-False-True-False-True] 62.1510μs 29.2185μs 34.2249 KOps/s 33.8760 KOps/s $\color{#35bf28}+1.03\%$
test_step_mdp_speed[False-False-True-False-False] 44.4810μs 17.8628μs 55.9823 KOps/s 54.8899 KOps/s $\color{#35bf28}+1.99\%$
test_step_mdp_speed[False-False-False-True-True] 81.7410μs 46.2594μs 21.6172 KOps/s 21.0162 KOps/s $\color{#35bf28}+2.86\%$
test_step_mdp_speed[False-False-False-True-False] 60.6820μs 31.3248μs 31.9235 KOps/s 31.1895 KOps/s $\color{#35bf28}+2.35\%$
test_step_mdp_speed[False-False-False-False-True] 60.2810μs 30.9254μs 32.3359 KOps/s 31.9769 KOps/s $\color{#35bf28}+1.12\%$
test_step_mdp_speed[False-False-False-False-False] 45.8610μs 20.0727μs 49.8190 KOps/s 49.2687 KOps/s $\color{#35bf28}+1.12\%$
test_values[generalized_advantage_estimate-True-True] 26.4242ms 25.1056ms 39.8318 Ops/s 38.3614 Ops/s $\color{#35bf28}+3.83\%$
test_values[vec_generalized_advantage_estimate-True-True] 90.7085ms 2.7150ms 368.3267 Ops/s 366.2334 Ops/s $\color{#35bf28}+0.57\%$
test_values[td0_return_estimate-False-False] 90.8520μs 66.5564μs 15.0249 KOps/s 14.8653 KOps/s $\color{#35bf28}+1.07\%$
test_values[td1_return_estimate-False-False] 59.7554ms 58.2435ms 17.1693 Ops/s 17.4316 Ops/s $\color{#d91a1a}-1.50\%$
test_values[vec_td1_return_estimate-False-False] 1.4223ms 1.0926ms 915.2399 Ops/s 909.7982 Ops/s $\color{#35bf28}+0.60\%$
test_values[td_lambda_return_estimate-True-False] 95.1251ms 92.8634ms 10.7685 Ops/s 10.6766 Ops/s $\color{#35bf28}+0.86\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.4583ms 1.0891ms 918.2041 Ops/s 914.4188 Ops/s $\color{#35bf28}+0.41\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 26.6181ms 26.2636ms 38.0756 Ops/s 39.3201 Ops/s $\color{#d91a1a}-3.17\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9456ms 0.7636ms 1.3095 KOps/s 1.3524 KOps/s $\color{#d91a1a}-3.17\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7567ms 0.7006ms 1.4274 KOps/s 1.4677 KOps/s $\color{#d91a1a}-2.74\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5555ms 1.4767ms 677.1772 Ops/s 672.5737 Ops/s $\color{#35bf28}+0.68\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7762ms 0.7118ms 1.4050 KOps/s 1.4386 KOps/s $\color{#d91a1a}-2.34\%$
test_dqn_speed 92.6287ms 1.4921ms 670.2050 Ops/s 712.2702 Ops/s $\textbf{\color{#d91a1a}-5.91\%}$
test_ddpg_speed 3.0643ms 2.7590ms 362.4479 Ops/s 362.8263 Ops/s $\color{#d91a1a}-0.10\%$
test_sac_speed 8.3386ms 7.9274ms 126.1449 Ops/s 126.1708 Ops/s $\color{#d91a1a}-0.02\%$
test_redq_speed 12.1447ms 10.1063ms 98.9484 Ops/s 99.1859 Ops/s $\color{#d91a1a}-0.24\%$
test_redq_deprec_speed 11.6402ms 10.9940ms 90.9589 Ops/s 92.4192 Ops/s $\color{#d91a1a}-1.58\%$
test_td3_speed 8.0231ms 7.9000ms 126.5821 Ops/s 124.9968 Ops/s $\color{#35bf28}+1.27\%$
test_cql_speed 26.7741ms 25.6671ms 38.9604 Ops/s 39.6365 Ops/s $\color{#d91a1a}-1.71\%$
test_a2c_speed 6.2882ms 5.6162ms 178.0569 Ops/s 180.8574 Ops/s $\color{#d91a1a}-1.55\%$
test_ppo_speed 7.8126ms 5.8641ms 170.5284 Ops/s 169.0929 Ops/s $\color{#35bf28}+0.85\%$
test_reinforce_speed 4.7695ms 4.4656ms 223.9346 Ops/s 223.4778 Ops/s $\color{#35bf28}+0.20\%$
test_iql_speed 21.2833ms 19.9798ms 50.0506 Ops/s 50.7309 Ops/s $\color{#d91a1a}-1.34\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.8843ms 6.7535ms 148.0705 Ops/s 150.3999 Ops/s $\color{#d91a1a}-1.55\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.5166ms 0.5329ms 1.8766 KOps/s 1.8712 KOps/s $\color{#35bf28}+0.29\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7286ms 0.5143ms 1.9443 KOps/s 1.9471 KOps/s $\color{#d91a1a}-0.15\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.9644ms 6.6481ms 150.4178 Ops/s 152.0668 Ops/s $\color{#d91a1a}-1.08\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8505ms 0.5163ms 1.9369 KOps/s 1.8945 KOps/s $\color{#35bf28}+2.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7249ms 0.5004ms 1.9983 KOps/s 1.9681 KOps/s $\color{#35bf28}+1.54\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.1769ms 2.0239ms 494.1046 Ops/s 487.9081 Ops/s $\color{#35bf28}+1.27\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.1149ms 1.9161ms 521.8857 Ops/s 513.9129 Ops/s $\color{#35bf28}+1.55\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.0283ms 6.8063ms 146.9236 Ops/s 145.9484 Ops/s $\color{#35bf28}+0.67\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1269s 0.7920ms 1.2627 KOps/s 1.4316 KOps/s $\textbf{\color{#d91a1a}-11.80\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.8329ms 0.7065ms 1.4155 KOps/s 1.4308 KOps/s $\color{#d91a1a}-1.07\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.0393ms 6.6951ms 149.3636 Ops/s 149.6522 Ops/s $\color{#d91a1a}-0.19\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.5951ms 0.5315ms 1.8816 KOps/s 1.9296 KOps/s $\color{#d91a1a}-2.48\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7440ms 0.5097ms 1.9620 KOps/s 2.0118 KOps/s $\color{#d91a1a}-2.48\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.9266ms 6.6328ms 150.7658 Ops/s 151.8527 Ops/s $\color{#d91a1a}-0.72\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9363ms 0.5176ms 1.9320 KOps/s 1.9548 KOps/s $\color{#d91a1a}-1.17\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6802ms 0.4981ms 2.0076 KOps/s 2.0156 KOps/s $\color{#d91a1a}-0.39\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.9324ms 6.8838ms 145.2693 Ops/s 146.9265 Ops/s $\color{#d91a1a}-1.13\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.5608ms 0.6868ms 1.4561 KOps/s 1.4356 KOps/s $\color{#35bf28}+1.43\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8239ms 0.6637ms 1.5067 KOps/s 1.5099 KOps/s $\color{#d91a1a}-0.21\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1450s 7.9598ms 125.6306 Ops/s 126.1411 Ops/s $\color{#d91a1a}-0.40\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 19.2812ms 16.3981ms 60.9826 Ops/s 59.7284 Ops/s $\color{#35bf28}+2.10\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.9276ms 1.3660ms 732.0635 Ops/s 798.2301 Ops/s $\textbf{\color{#d91a1a}-8.29\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1260s 7.5919ms 131.7189 Ops/s 132.8677 Ops/s $\color{#d91a1a}-0.86\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 18.4976ms 16.1788ms 61.8094 Ops/s 59.5636 Ops/s $\color{#35bf28}+3.77\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.3725ms 1.2957ms 771.7573 Ops/s 784.9669 Ops/s $\color{#d91a1a}-1.68\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1281s 10.2422ms 97.6350 Ops/s 129.7929 Ops/s $\textbf{\color{#d91a1a}-24.78\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 19.2532ms 16.4321ms 60.8566 Ops/s 59.2750 Ops/s $\color{#35bf28}+2.67\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.4903ms 1.4530ms 688.2518 Ops/s 652.2234 Ops/s $\textbf{\color{#35bf28}+5.52\%}$
@vmoens vmoens linked an issue Jul 10, 2024 that may be closed by this pull request
[BUG] Unable to install torchrl via pip #2035
Closed
@vmoens vmoens merged commit 935e8da into main Jul 28, 2024
54 of 56 checks passed
@vmoens vmoens deleted the add-python3.12-setup branch July 28, 2024 08:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
2 participants
@vmoens @facebook-github-bot