Skip to content

Commit 07e5c55

Browse files
authored
[MoE] Fix distributed wait api (#3365)
1 parent b4b1bdc commit 07e5c55

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/language_model/moe/dygraph/run_moe_pretrain.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -494,7 +494,7 @@ def do_train(args):
494494
group=sharding_group,
495495
sync_op=True)
496496
# Multi stream operation will be supported later
497-
dist.wait(tensor=p, group=sharding_group, sync_op=True)
497+
dist.wait(tensor=p, group=sharding_group, use_calc_stream=True)
498498
else:
499499
initialize_mp_dp_parameters(model, hcg)
500500

0 commit comments

Comments
 (0)