DeepseekMoE support with Fused MoE kernel#2453

Merged

WoosukKwon merged 20 commits intovllm-project:mainfrom

zwd003:deepseekmoe-dev

Jan 30, 2024

Commits on Jan 29, 2024

init support

esmeetu
authored and
zwd003
committed
deepseekmoe support
zwd003
committed
add fused moe kernel
zwd003
committed
Add more code comments.
zwd003
committed
bug fix
zwd003
committed
fp16 support
zwd003
committed
bug fix
zwd003
committed
remove global static cache
zwd003
committed
add unit test
zwd003
committed
code format
zwd003
committed
optimizing performance on small batch
zwd003
committed
fix up
zwd003
committed
fix up
zwd003
committed
rewrite alig_block_size in cpp
zwd003
committed
fix up
zwd003
committed
fix up
zwd003
committed
fix up
zwd003
committed
fix up

esmeetu
authored and
zwd003
committed

Commits on Jan 30, 2024