[LLM] Support multi machine deployment

[ltd0924]

Before submitting

• Lint code. If there are lint issues, please format the code first.

# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py

• Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

PR changes

Description

[paddle-bot]

Thanks for your contribution!

[CLAassistant]

All committers have signed the CLA.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 51.42%. Comparing base (765ab8d) to head (ae09a9c).
Report is 351 commits behind head on develop.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9872      +/-   ##
===========================================
- Coverage    52.06%   51.42%   -0.65%     
===========================================
  Files          734      745      +11     
  Lines       116443   120605    +4162     
===========================================
+ Hits         60625    62018    +1393     
- Misses       55818    58587    +2769     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.