-
-
Notifications
You must be signed in to change notification settings - Fork 682
docs: update explanation for separate config use in litellm #958
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
@@ -153,16 +153,40 @@ Ensure the current user can run Docker commands **without using sudo**. You can | |||
|
|||
You can set your Chat Model and Embedding Model in the following ways: | |||
|
|||
- **Using LiteLLM (Recommended)**: We now support LiteLLM as a backend for integration with multiple LLM providers. You can configure as follows: | |||
- **Using LiteLLM (Recommended)**: We now support LiteLLM as a backend for integration with multiple LLM providers. You can configure in two ways: | |||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think put Unified API before seperate API will be more user friendly
.env.example
Outdated
@@ -7,25 +7,56 @@ For more information about configuration options, please refer to the documentat | |||
|
|||
""" | |||
|
|||
# ========================================== | |||
# Global configs: | |||
USE_AZURE=False |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Remove these options
LITELLM_PROXY_API_KEY=<replace_with_your_siliconflow_api_key> | ||
LITELLM_PROXY_API_BASE=https://api.siliconflow.cn/v1 | ||
|
||
Option 2: Unified API base for both models |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Switch
* docs: update explanation for separate config use in litellm * docs: update default backend to `rdagent.oai.backend.LiteLLMAPIBackend` * docs: update .rst format * Update installation_and_configuration.rst
* docs: update explanation for separate config use in litellm * docs: update default backend to `rdagent.oai.backend.LiteLLMAPIBackend` * docs: update .rst format * Update installation_and_configuration.rst
Description
Motivation and Context
How Has This Been Tested?
Screenshots of Test Results (if appropriate):
Types of changes
📚 Documentation preview 📚: https://RDAgent--958.org.readthedocs.build/en/958/