Skip to content

Commit 89ff18d

Browse files
committed
[Refactor] refine code
1 parent 9b7c056 commit 89ff18d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

paddlenlp/experimental/transformers/fused_transformer_layers.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -217,7 +217,7 @@ def __init__(
217217
kv_num_heads=-1,
218218
cachekv_int8_type=None,
219219
rank_id=-1,
220-
moe_config=None,
220+
moe_config=MoeConfig(),
221221
):
222222
self.embed_dim = embed_dim
223223
self.num_heads = num_heads

0 commit comments

Comments
 (0)