Skip to content

Commit f002e9a

Browse files
authored
[Cleanup] Only log MoE DP setup warning if DP is enabled (#21315)
Signed-off-by: mgoin <[email protected]>
1 parent a1f3610 commit f002e9a

File tree

1 file changed

+5
-4
lines changed
  • vllm/model_executor/layers/fused_moe

1 file changed

+5
-4
lines changed

vllm/model_executor/layers/fused_moe/config.py

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -464,10 +464,11 @@ def make(
464464
)
465465
else:
466466
_quant_config = FusedMoEQuantConfig()
467-
logger.warning_once("MoE DP setup unable to determine "
468-
"quantization scheme or unsupported "
469-
"quantization type. This model will "
470-
"not run with DP enabled.")
467+
if moe_parallel_config.dp_size > 1:
468+
logger.warning_once("MoE DP setup unable to determine "
469+
"quantization scheme or unsupported "
470+
"quantization type. This model will "
471+
"not run with DP enabled.")
471472
else:
472473
_quant_config = quant_config
473474

0 commit comments

Comments
 (0)