feat: add data parallel rank to KVEventBatch#18925

Merged

simon-mo merged 20 commits intovllm-project:mainfrom

PeaBrane:rupei/kv-events-dp

Jun 4, 2025

Commits on Jun 3, 2025

publish dp name in kv event, and only publish if master in dp group

PeaBrane
authored and
alec-flowers
committed
use dp and tp 2 test_kv_cache_events

PeaBrane
authored and
alec-flowers
committed
works for dp > 1 but not tp > 1

PeaBrane
authored and
alec-flowers
committed
cleanups

PeaBrane
authored and
alec-flowers
committed
restore dp and tp

PeaBrane
authored and
alec-flowers
committed
loop until fully done

PeaBrane
authored and
alec-flowers
committed
revert unneeded master checks

PeaBrane
authored and
alec-flowers
committed
dp_rank does not have to be an attribute

PeaBrane
authored and
alec-flowers
committed
restore non-empty events check

PeaBrane
authored and
alec-flowers
committed
let publisher handle dp rank identification

PeaBrane
authored and
alec-flowers
committed
no need for elif with return guard

PeaBrane
authored and
alec-flowers
committed
same as above

PeaBrane
authored and
alec-flowers
committed
fix test loop logic

PeaBrane
authored and
alec-flowers
committed
idiomatic async timeout, default dp_rank to 0

PeaBrane
authored and
alec-flowers
committed
address reviewer comments
alec-flowers
committed
Update vllm/distributed/kv_events.py

alec-flowers
and
njhill
committed
Update vllm/distributed/kv_events.py

alec-flowers
and
njhill
committed
refactor: dp port mainpulations moved to zmqpublisher class
alec-flowers
committed
fix async timeout and multi gpu marker
PeaBrane
committed
run test_kv_cache_events_dp test with 4 GPUs
njhill
committed