Merging the latest upstream into PPPL#13

Merged

Alexei-V-Ivanov-AMD merged 121 commits intoAlexei-V-Ivanov-AMD:PPL_LL2_MC.20240903from

vllm-project:main

Sep 5, 2024

Commits on Aug 26, 2024

[Bugfix]: Use float32 for base64 embedding (#7855)
HollowMan6
authored
[CI/Build] Avoid downloading all HF files in `RemoteOpenAIServer` (#7836)
DarkLight1337
authored
[Performance][BlockManagerV2] Mark prefix cache block as computed after schedule (#7822)
comaniac
authored
[Misc] Update `qqq` to use vLLMParameters (#7805)
dsikka
authored
[Misc] Update `gptq_marlin_24` to use vLLMParameters (#7762)

dsikka
and
mgoin
authored
[misc] fix custom allreduce p2p cache file generation (#7853)
youkaichao
authored
[Bugfix] neuron: enable tensor parallelism (#7562)
omrishiv
authored

Commits on Aug 27, 2024

Commits on Aug 28, 2024

Commits on Aug 29, 2024

Commits on Aug 30, 2024

Commits on Sep 1, 2024

[Misc] Optional installation of audio related packages (#8063)
ywang96
authored

Commits on Sep 3, 2024

Commits on Sep 4, 2024

Commits on Sep 5, 2024