Skip to content

Commit 2c6b485

Browse files
deepllzMangodadada
authored andcommitted
Fix qwen benchmark (PaddlePaddle#8969)
1 parent 7c280b7 commit 2c6b485

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

β€Žtests/test_tipc/dygraph/hybrid_parallelism/qwen/N4C32/qwen-qwen-14b_seqlen4096_pretrain_bs32_bf16_MP2-PP1-sharding16-mbs1-acc2.shβ€Ž

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ param+="data_parallel_degree=1 "
1919
param+="tensor_parallel_degree=2 "
2020
param+="pipeline_parallel_degree=1 "
2121
param+="virtual_pp_degree=1 "
22-
param+="sequence_parallel=0 "
22+
param+="sequence_parallel=1 "
2323
param+="sharding_parallel_degree=16 "
2424
param+="sharding=stage1 "
2525
param+="recompute=0 "

β€Žtests/test_tipc/dygraph/hybrid_parallelism/qwen/N4C32/qwen-qwen-7b_seqlen4096_pretrain_bs32_bf16_MP1-PP1-sharding32-mbs1-acc1.shβ€Ž

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ param+="data_parallel_degree=1 "
1919
param+="tensor_parallel_degree=1 "
2020
param+="pipeline_parallel_degree=1 "
2121
param+="virtual_pp_degree=1 "
22-
param+="sequence_parallel=1 "
22+
param+="sequence_parallel=0 "
2323
param+="sharding_parallel_degree=32 "
2424
param+="sharding=stage1 "
2525
param+="recompute=0 "

0 commit comments

Comments
Β (0)