[Feature] MCTSForest

[vmoens]

Stack from ghstack (oldest at bottom):

• [Feature] MCTS policy #2359
• [Feature] MCTS Scoring functions #2358
• [Feature] TensorSpec.enumerate() #2354
• -> [Feature] MCTSForest #2307
• [Feature] TensorDictMap #2306
• [Feature] TensorDictMap Query module #2305
• [Feature] TensorDictMap hashing functions #2304

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2307

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 18 New Failures, 1 Cancelled Job, 8 Unrelated Failures

As of commit a382e65 with merge base 35a1c5b ():

NEW FAILURES - The following jobs have failed:

• Continuous Benchmark (PR) / CPU Pytest benchmark (gh)
  Process completed with exit code 1.
• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  Process completed with exit code 4.
• Examples Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 14193ca041f62cd1b92069cf8c53b26d2bf6e6edb5393e2f12ba190beab108e9 /exec failed with exit code 1
• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t d25ea0f12e7fbc51c12d008dfa66006863b7622d43330f0038be31eed20e4781 /exec failed with exit code 1
• Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 96a413c9d8ec2b67b320071680f98929c186712bddc841e41bae7b2224e33894 /exec failed with exit code 1
• Libs Tests on Linux / unittests-sklearn (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 89778aa1b265b8283163308beabe1197e34367340724882a00db328bc82db23d /exec failed with exit code 1
• Lint / python-source-and-configs / linux-job (gh)
  RuntimeError: Command docker exec -t 8f6073422509c18ce450d888aee5c5574c8e110601ac15e9117d76626bbd5a12 /exec failed with exit code 1
• RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 792a7c8d4072a2237f01531c96e24937cfcd12388e7f43165db7caaefc1937f8 /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh)
  RuntimeError: Command docker exec -t 61cc000740f2ea5aa87abb247bad005e5414bf6a285ef4d035776ee6f63eba45 /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh)
  RuntimeError: Command docker exec -t 592824bcdc2302e4a2d51e9cefd15ee1e92e4c2b1ba26a9cd8fbef32d7a31529 /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.12) / linux-job (gh)
  RuntimeError: Command docker exec -t 13069841496a05bf81d76d52d7e94eb2a7d4d33600da3ad13c072c81a86e042d /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.8) / linux-job (gh)
  RuntimeError: Command docker exec -t 19cb8d9f0d93bd9f26c0a11f7a5e050917659bacb03db22bc4ffe8a3700f4568 /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.9) / linux-job (gh)
  RuntimeError: Command docker exec -t 24ba3c6590f276bde923a866e56ccf1cf0e2ab51dcd7e9cf512a43df6a995052 /exec failed with exit code 1
• Unit-tests on Linux / tests-gpu (3.11, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 196248be2f11602d58301c23bd32fcf512a9b52c854c7b2b84d59d0089d9284b /exec failed with exit code 1
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh)
  RuntimeError: Command docker exec -t 5dc1890ab575f89cf326656ee8d40bcffef38224b170b6a1e0dc62585e342763 /exec failed with exit code 1
• Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 78001c21d822c73bc1231d90d1e85e41d8fa745593b891622d3bb3514dcf7674 /exec failed with exit code 1
• Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job (gh)
  RuntimeError: Command docker exec -t 650c9922e61158d51f903ce486bb4a8dac703b1dd4607b67b868984cf53b4ef7 /exec failed with exit code 1
• Wheels / build-wheel-windows (3.12, 3.12) (gh)
  Process completed with exit code 1.

CANCELLED JOB - The following job was cancelled. Please retry:

• Wheels / build-wheel-windows (3.9, 3.9) (gh)

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cpu (gh) (similar failure)
  Unable to find any artifacts for the associated workflow
• Wheels / build-wheel-windows (3.10, 3.10.3) (gh) (matched win rule in flaky-rules.json)
  ##[error]The operation was canceled.
• Wheels / build-wheel-windows (3.11, 3.11) (gh) (matched win rule in flaky-rules.json)
  ##[error]The operation was canceled.
• Wheels / build-wheel-windows (3.8, 3.8) (gh) (matched win rule in flaky-rules.json)
  ##[error]The operation was canceled.

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda11_8 (gh) (trunk failure)
• Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_1 (gh) (trunk failure)
  Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_4 (gh) (trunk failure)
  Unable to find any artifacts for the associated workflow
• Unit-tests on Windows / unittests-cpu / windows-job (gh) (trunk failure)
  Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.