[Performance] Fix queuing in llm wrappers

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3125

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 1 Cancelled Job, 13 Unrelated Failures

As of commit 5233ccf with merge base 0592fdc ():

NEW FAILURES - The following jobs have failed:

• Continuous Benchmark (PR) / CPU Pytest benchmark (gh)
  Process completed with exit code 2.
• Habitat Tests on Linux / tests (3.9, 12.8) / linux-job (gh)
  RuntimeError: Command docker exec -t c9f770bafc2e3257dbed163cb4827946b5f4cfd72e4de0124529e7ee125bfdf3 /exec failed with exit code 1
• Libs Tests on Linux / unittests-sklearn (3.10, 12.8) / linux-job (gh)
  test/test_libs.py::TestOpenML::test_data[magic]
• Lint / python-source-and-configs / linux-job (gh)
  RuntimeError: Command docker exec -t cce9cf2491ac9767f7e391fd38020144f9d560b2ee3d86c79407f6fc196a50d2 /exec failed with exit code 1
• SOTA Tests on Linux / tests (3.9, 12.8) / linux-job (gh)
  RuntimeError: Command docker exec -t c40ae3acb90addc72e08260c88d7c786786dd4527ee1bf88763f963b3aaf268b /exec failed with exit code 1

CANCELLED JOB - The following job was cancelled. Please retry:

• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  ##[error]The operation was canceled.

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Continuous Benchmark / CPU Pytest benchmark (gh) (trunk failure)
  Process completed with exit code 2.
• Continuous Benchmark / GPU Pytest benchmark (gh) (trunk failure)
  Process completed with exit code 2.
• Libs Tests on Linux / unittests-gym (3.9, 12.8) / linux-job (gh) (trunk failure)
  AttributeError: module 'torch.utils._pytree' has no attribute 'register_pytree_node'
• LLM Tests on Linux / unittests (3.9, 12.8) / linux-job (gh) (trunk failure)
  ##[error]The operation was canceled.
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh) (trunk failure)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh) (trunk failure)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-cpu (3.12) / linux-job (gh) (trunk failure)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-cpu (3.9) / linux-job (gh) (trunk failure)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-gpu (3.11, 12.8) / linux-job (gh) (trunk failure)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-olddeps (3.9, 11.6) / linux-job (gh) (trunk failure)
  AttributeError: module 'torch.utils._pytree' has no attribute 'register_pytree_node'
• Unit-tests on Linux / tests-optdeps (3.11, 12.8) / linux-job (gh) (trunk failure)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job (gh) (trunk failure)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Windows / unittests-cpu (3.10, windows.4xlarge, cpu) / windows-job (gh) (trunk failure)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]

This comment was automatically generated by Dr. CI and updates every 15 minutes.