Oct 01 rebase #353

kzawora-intel · 2024-10-01T14:34:37Z

No description provided.

…ject#8814)

…ect#8818)

…oject#8872) Signed-off-by: kevin <[email protected]>

…vllm-project#8861)

…m-project#8820)

…rovided (vllm-project#8568)

…ect#8829)

…mpatibility (vllm-project#8764)

Signed-off-by: Max de Bayser <[email protected]>

Signed-off-by: Peter Pan <[email protected]>

…-project#8892)

…project#8875)

…od (vllm-project#7271)

Co-authored-by: mgoin <[email protected]>

vllm-project#8378) Co-authored-by: Varun Sundar Rabindranath <[email protected]>

Signed-off-by: tylertitsworth <[email protected]> Co-authored-by: youkaichao <[email protected]>

…t#8443)

Co-authored-by: Roger Wang <[email protected]>

…ct#8741) Co-authored-by: Tyler Michael Smith <[email protected]>

…ng (vllm-project#8930)

…-project#8870) Co-authored-by: Roger Wang <[email protected]>

…ter (vllm-project#8942)

…ernels and Jamba model (vllm-project#8533)

…ject#8951)

Co-authored-by: DarkLight1337 <[email protected]>

…llm-project#8946)

)

…oject#8957)

Signed-off-by: kevin <[email protected]>

…or spec decode CI tests. (vllm-project#8975)

…lm-project#8252) Signed-off-by: Joe Runde <[email protected]> Co-authored-by: Nick Hill <[email protected]>

…8976) Signed-off-by: kevin <[email protected]> Co-authored-by: Cody Yu <[email protected]>

…t#8969)

…ed With No Placeholders (vllm-project#8991) Signed-off-by: Alex-Brooks <[email protected]>

…I-API (vllm-project#8965)

tlrmchlsmth and others added 30 commits September 26, 2024 10:07

[Build/CI] Upgrade to gcc 10 in the base build Docker image (vllm-pro…

f70bcca

…ject#8814)

[Docs] Add README to the build docker image (vllm-project#8825)

520db4d

[CI/Build] Fix missing ci dependencies (vllm-project#8834)

68988d4

[misc][installation] build from source without compilation (vllm-proj…

70de39f

…ect#8818)

[ci] Soft fail Entrypoints, Samplers, LoRA, Decoder-only VLM (vllm-pr…

d9cfbc8

…oject#8872) Signed-off-by: kevin <[email protected]>

[Bugfix] Include encoder prompts len to non-stream api usage response (…

93d364d

…vllm-project#8861)

[Misc] Change dummy profiling and BOS fallback warns to log once (vll…

b28d210

…m-project#8820)

[Bugfix] Fix print_warning_once's line info (vllm-project#8867)

e2f6f26

fix validation: Only set tool_choice auto if at least one tool is p…

ee2da3e

…rovided (vllm-project#8568)

[Bugfix] Fixup advance_step.cu warning (vllm-project#8815)

71d21c7

[BugFix] Fix test breakages from transformers 4.45 upgrade (vllm-proj…

4b377d6

…ect#8829)

[Installation] Allow lower versions of FastAPI to maintain Ray 2.9 co…

1b49148

…mpatibility (vllm-project#8764)

[Feature] Add support for Llama 3.1 and 3.2 tool use (vllm-project#8343)

344cd2b

Signed-off-by: Max de Bayser <[email protected]>

[Core] renamePromptInputs and inputs (vllm-project#8876)

3b00b9c

[misc] fix collect env (vllm-project#8894)

dc4e3df

[MISC] Fix invalid escape sequence '\' (vllm-project#8830)

0e08875

Signed-off-by: Peter Pan <[email protected]>

[Bugfix][VLM] Fix Fuyu batching inference with max_num_seqs>1 (vllm…

6d792d2

…-project#8892)

[TPU] Update pallas.py to support trillium (vllm-project#8871)

8df2dc3

[torch.compile] use empty tensor instead of None for profiling (vllm-…

a9b15c6

…project#8875)

[Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear meth…

172d1cd

…od (vllm-project#7271)

[Bugfix] fix for deepseek w4a16 (vllm-project#8906)

c5d5535

Co-authored-by: mgoin <[email protected]>

[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (

c2ec430

vllm-project#8378) Co-authored-by: Varun Sundar Rabindranath <[email protected]>

[misc][distributed] add VLLM_SKIP_P2P_CHECK flag (vllm-project#8911)

18e60d7

[Core] Priority-based scheduling in async engine (vllm-project#8850)

bd429f2

[misc] fix wheel name (vllm-project#8919)

d86f6b2

[Bugfix][Intel] Fix XPU Dockerfile Build (vllm-project#7824)

260024a

Signed-off-by: tylertitsworth <[email protected]> Co-authored-by: youkaichao <[email protected]>

[Misc] Remove vLLM patch of BaichuanTokenizer (vllm-project#8921)

b0298aa

[Bugfix] Fix code for downloading models from modelscope (vllm-projec…

39d3f8d

…t#8443)

[Bugfix] Fix PP for Multi-Step (vllm-project#8887)

19d02ff

[CI/Build] Update models tests & examples (vllm-project#8874)

e1a3f5e

Co-authored-by: Roger Wang <[email protected]>

ElizaWszola and others added 25 commits September 28, 2024 18:19

[Bugfix] Fix Marlin MoE act order when is_k_full == False (vllm-proje…

d081da0

…ct#8741) Co-authored-by: Tyler Michael Smith <[email protected]>

[CI/Build] Add test decorator for minimum GPU memory (vllm-project#8925)

26a68d5

[Build/CI] Set FETCHCONTENT_BASE_DIR to one location for better cachi…

2e7fe7e

…ng (vllm-project#8930)

[Model] Support Qwen2.5-Math-RM-72B (vllm-project#8896)

bc2ef1f

[Model][LoRA]LoRA support added for MiniCPMV2.5 (vllm-project#7199)

3d49776

[BugFix] Fix seeded random sampling with encoder-decoder models (vllm…

31f46a0

…-project#8870) Co-authored-by: Roger Wang <[email protected]>

[Misc] Fix typo in BlockSpaceManagerV1 (vllm-project#8944)

1fb9c1b

[Frontend] Added support for HF's new continue_final_message parame…

6c9ba48

…ter (vllm-project#8942)

[Kernel][Model] Varlen prefill + Prefill chunking support for mamba k…

f13a07b

…ernels and Jamba model (vllm-project#8533)

[Model] support input embeddings for qwen2vl (vllm-project#8856)

e01ab59

[Misc][CI/Build] Include cv2 via mistral_common[opencv] (vllm-pro…

b6d7392

…ject#8951)

[Model][LoRA]LoRA support added for MiniCPMV2.6 (vllm-project#8943)

8e60afa

Co-authored-by: DarkLight1337 <[email protected]>

[Model] Expose InternVL2 max_dynamic_patch as a mm_processor_kwarg (v…

2ae25f7

…llm-project#8946)

[Core] Make scheduling policy settable via EngineArgs (vllm-project#8956

be76e5a

)

[Misc] Adjust max_position_embeddings for LoRA compatibility (vllm-pr…

1cabfce

…oject#8957)

[ci] Add CODEOWNERS for test directories (vllm-project#8795)

1425a1b

Signed-off-by: kevin <[email protected]>

[CI][SpecDecode] Fix spec decode tests, use flash attention backend f…

bce3244

…or spec decode CI tests. (vllm-project#8975)

[Frontend][Core] Move guided decoding params into sampling params (vl…

062c89e

…lm-project#8252) Signed-off-by: Joe Runde <[email protected]> Co-authored-by: Nick Hill <[email protected]>

[CI/Build] Fix machete generated kernel files ordering (vllm-project#…

aaccca2

…8976) Signed-off-by: kevin <[email protected]> Co-authored-by: Cody Yu <[email protected]>

[torch.compile] fix tensor alias (vllm-project#8982)

7da2487

[Misc] add process_weights_after_loading for DummyLoader (vllm-projec…

82f3937

…t#8969)

[Bugfix] Fix Fuyu tensor parallel inference (vllm-project#8986)

bc4eb65

[Bugfix] Fix Token IDs Reference for MiniCPM-V When Images are Provid…

1fe0a42

…ed With No Placeholders (vllm-project#8991) Signed-off-by: Alex-Brooks <[email protected]>

[Core] [Frontend] Priority scheduling for embeddings and in the OpenA…

35bd215

…I-API (vllm-project#8965)

Merge remote-tracking branch 'upstream/main' into HEAD

cafff17

mswiniarsk approved these changes Oct 1, 2024

View reviewed changes

kzawora-intel merged commit 25f4ed9 into habana_main Oct 2, 2024

kzawora-intel deleted the private/kzawora/rebase_01oct2024 branch October 7, 2024 12:51

kzawora-intel added the habana Issues or PRs submitted by Habana Labs label Nov 8, 2024

kzawora-intel added the rebase label Feb 18, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Oct 01 rebase #353

Oct 01 rebase #353

Uh oh!

kzawora-intel commented Oct 1, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

38 participants

Oct 01 rebase #353

Oct 01 rebase #353

Uh oh!

Conversation

kzawora-intel commented Oct 1, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

38 participants