[Bugfix] Change kv scaling factor by param json on nvidia gpu#11688
Merged
mgoin merged 2 commits intovllm-project:mainfrom Jan 2, 2025
Merged
[Bugfix] Change kv scaling factor by param json on nvidia gpu#11688mgoin merged 2 commits intovllm-project:mainfrom
mgoin merged 2 commits intovllm-project:mainfrom