Skip to content

docs: update explanation for separate config use in litellm #958

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jun 13, 2025

Conversation

Hoder-zyf
Copy link
Collaborator

@Hoder-zyf Hoder-zyf commented Jun 13, 2025

Description

Motivation and Context

How Has This Been Tested?

  • If you are adding a new feature, test on your own test scripts.

Screenshots of Test Results (if appropriate):

  1. Your own tests:

Types of changes

  • Fix bugs
  • Add new feature
  • Update documentation

📚 Documentation preview 📚: https://RDAgent--958.org.readthedocs.build/en/958/

@@ -153,16 +153,40 @@ Ensure the current user can run Docker commands **without using sudo**. You can

You can set your Chat Model and Embedding Model in the following ways:

- **Using LiteLLM (Recommended)**: We now support LiteLLM as a backend for integration with multiple LLM providers. You can configure as follows:
- **Using LiteLLM (Recommended)**: We now support LiteLLM as a backend for integration with multiple LLM providers. You can configure in two ways:

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think put Unified API before seperate API will be more user friendly

.env.example Outdated
@@ -7,25 +7,56 @@ For more information about configuration options, please refer to the documentat

"""

# ==========================================
# Global configs:
USE_AZURE=False
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove these options

LITELLM_PROXY_API_KEY=<replace_with_your_siliconflow_api_key>
LITELLM_PROXY_API_BASE=https://api.siliconflow.cn/v1

Option 2: Unified API base for both models
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Switch

@Hoder-zyf Hoder-zyf merged commit 70ba930 into main Jun 13, 2025
9 checks passed
@Hoder-zyf Hoder-zyf deleted the zyf/config_mode_new branch June 13, 2025 10:32
WinstonLiyt pushed a commit that referenced this pull request Jun 16, 2025
* docs: update explanation for separate config use in litellm

* docs: update default backend to `rdagent.oai.backend.LiteLLMAPIBackend`

* docs: update .rst format

* Update installation_and_configuration.rst
qew21 pushed a commit that referenced this pull request Jun 16, 2025
* docs: update explanation for separate config use in litellm

* docs: update default backend to `rdagent.oai.backend.LiteLLMAPIBackend`

* docs: update .rst format

* Update installation_and_configuration.rst
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants