[Trainer] Support MoE

[DesmonDay]

PR types

New features

PR changes

Others

Description

Update trainer for moe model.

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 5.66038% with 100 lines in your changes missing coverage. Please review.

Project coverage is 53.99%. Comparing base (d8adc2b) to head (d854330).
Report is 638 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/trainer/trainer.py	3.50%	55 Missing ⚠️
paddlenlp/trainer/utils/helper.py	3.70%	26 Missing ⚠️
paddlenlp/trainer/training_args.py	13.63%	19 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #8511      +/-   ##
===========================================
- Coverage    54.03%   53.99%   -0.05%     
===========================================
  Files          618      618              
  Lines        96697    96783      +86     
===========================================
+ Hits         52248    52254       +6     
- Misses       44449    44529      +80     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[github-actions]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。

[github-actions]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。