add fuse_attention_ffn support for qwen

[deepllz]

PR types

Performance optimization

PR changes

Models

Description

千问模型增加fuse_attention_ffn的支持

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 50.00000% with 14 lines in your changes missing coverage. Please review.

Project coverage is 53.86%. Comparing base (87edf28) to head (95c1780).
Report is 242 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/transformers/qwen/modeling.py	46.15%	14 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #8526      +/-   ##
===========================================
- Coverage    53.87%   53.86%   -0.01%     
===========================================
  Files          620      620              
  Lines        97081    97101      +20     
===========================================
+ Hits         52299    52308       +9     
- Misses       44782    44793      +11     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[ZHUI]

PaddleNLP/paddlenlp/transformers/qwen/modeling.py

Lines 474 to 496 in 95c1780

	def get_tensor_parallel_split_mappings(num_hidden_layers):
	final_actions = {}
	base_actions = {
	# Column Linear
	"lm_head.weight": partial(fn, is_column=True),
	"qwen.h.0.mlp.w2.weight": partial(fn, is_column=True),
	"qwen.h.0.mlp.w1.weight": partial(fn, is_column=True),
	"qwen.h.0.attn.c_attn.weight": partial(fn, is_column=True, is_naive_3fuse=True),
	"qwen.h.0.attn.c_attn.bias": partial(fn, is_column=True, is_naive_3fuse=True),
	# Row Linear
	"qwen.wte.weight": partial(fn, is_column=False),
	"qwen.h.0.mlp.c_proj.weight": partial(fn, is_column=False),
	"qwen.h.0.attn.c_proj.weight": partial(fn, is_column=False),
	}
	for key, action in base_actions.items():
	if "h.0." in key:
	for i in range(num_hidden_layers):
	final_actions[key.replace("h.0.", f"h.{i}.")] = action
	final_actions[key] = action
	return final_actions
	mappings = get_tensor_parallel_split_mappings(config.num_hidden_layers)

你要适配一下切分规则，tensor parallel 对 gate_up_fused_proj 的切分规则

[deepllz]

好哒，后续还有一个支持sp的pr，在下一个pr一起补充一下。