[llm]support dpo pp for qwen & llama

[lugimzzz]

PR types

New features

PR changes

Others

Description

支持pp

[paddle-bot]

Thanks for your contribution!

[wawltor]

LGTM

[codecov]

Codecov Report

Attention: Patch coverage is 18.24818% with 112 lines in your changes missing coverage. Please review.

Project coverage is 52.71%. Comparing base (801682d) to head (d5bb5d0).
Report is 271 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/transformers/kto_criterion.py	12.71%	103 Missing ⚠️
paddlenlp/transformers/llama/modeling_pp.py	25.00%	3 Missing ⚠️
paddlenlp/transformers/qwen/modeling_pp.py	40.00%	3 Missing ⚠️
paddlenlp/transformers/qwen2/modeling_pp.py	40.00%	3 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9695      +/-   ##
===========================================
+ Coverage    52.34%   52.71%   +0.37%     
===========================================
  Files          726      719       -7     
  Lines       117265   112504    -4761     
===========================================
- Hits         61377    59310    -2067     
+ Misses       55888    53194    -2694     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[wawltor]

LGTM