Skip to content

Commit 3e459a5

Browse files
committed
[Refactor] match fused moe api change
1 parent 1119b19 commit 3e459a5

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

paddlenlp/experimental/transformers/fused_transformer_layers.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -806,13 +806,14 @@ def compute_fused_moe(self, tmp_out, i):
806806
tmp_out,
807807
self.gate_weights[i],
808808
self.ffn1_weights[i],
809-
self.ffn1_biases[i],
810809
self.ffn2_weights[i],
811-
self.ffn2_biases[i],
810+
self.ffn1_biases[i],
812811
None,
812+
self.ffn2_biases[i],
813813
None,
814814
"None",
815815
self.config.moe_config.top_k,
816+
self.config.moe_config.norm_topk_prob,
816817
)
817818
return fused_moe_out
818819

0 commit comments

Comments
 (0)