[Bugfix] Remove hardcoded head_size=256 for Deepseek v2 and v3#12067
Merged
Isotr0py merged 4 commits intovllm-project:mainfrom Jan 16, 2025
Merged
[Bugfix] Remove hardcoded `head_size=256` for Deepseek v2 and v3#12067Isotr0py merged 4 commits intovllm-project:mainfrom
Isotr0py merged 4 commits intovllm-project:mainfrom
Commits
Commits on Jan 15, 2025
Commits on Jan 16, 2025
- committed
- committed
- committed