Skip to content

[v1] Implement HybridKVCacheManager to support hybrid models with different KV cache type#16101

Closed
heheda12345 wants to merge 39 commits intovllm-project:mainfrom
heheda12345:hybrid_mem
Closed

[v1] Implement HybridKVCacheManager to support hybrid models with different KV cache type#16101
heheda12345 wants to merge 39 commits intovllm-project:mainfrom
heheda12345:hybrid_mem

Commits

Commits on Apr 1, 2025

Commits on Apr 5, 2025

Commits on Apr 6, 2025

Commits on Apr 23, 2025

Commits on Apr 24, 2025

Commits on Apr 25, 2025

Commits on Apr 26, 2025