Skip to content

[Bugfix] Change kv scaling factor by param json on nvidia gpu#11688

Merged
mgoin merged 2 commits intovllm-project:mainfrom
bjmsong:fp8
Jan 2, 2025
Merged

[Bugfix] Change kv scaling factor by param json on nvidia gpu#11688
mgoin merged 2 commits intovllm-project:mainfrom
bjmsong:fp8

Commits

Commits on Jan 2, 2025