Add Featherless AI provider (access to 10,000+ open source models) #8277
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
@DarinVerheijke is attempting to deploy a commit to the LobeHub OSS Team on Vercel. A member of the Team first needs to authorize it. |
![greptile-apps[bot]](https://avatars.githubusercontent.com/in/867647?s=60&v=4){kind=small}
There was a problem hiding this comment.
Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.
Reviewer's GuideThis PR integrates Featherless AI as a new model provider by extending configuration schemas and environment variables, registering the provider and its models in the application and settings UI, implementing the runtime adapter, adding Docker support, and providing usage documentation in both English and Chinese. Entity relationship diagram for Featherless AI models and providererDiagram
FEATHERLESSAI_PROVIDER ||--o{ FEATHERLESSAI_MODEL : provides
FEATHERLESSAI_MODEL {
string id
string displayName
string description
int contextWindowTokens
bool enabled
object pricing
string type
}
FEATHERLESSAI_PROVIDER {
string id
string name
string description
string url
}
Class diagram for Featherless AI provider integrationclassDiagram
class ModelProviderCard {
+chatModels: ChatModelCard[]
+checkModel: string
+description: string
+disableBrowserRequest: boolean
+id: string
+modelsUrl: string
+name: string
+settings: object
+url: string
}
class FeatherlessAIProviderCard {
<<implements>> ModelProviderCard
}
class LobeFeatherlessAI {
+baseURL: string
+debug: object
+provider: ModelProvider
}
class ModelProvider {
<<enum>>
+FeatherlessAI
}
class UserKeyVaults {
+featherlessai?: OpenAICompatibleKeyVault
}
ModelProviderCard <|.. FeatherlessAIProviderCard
ModelProvider <|-- LobeFeatherlessAI
UserKeyVaults --> OpenAICompatibleKeyVault
File-Level Changes
Tips and commandsInteracting with Sourcery
Customizing Your ExperienceAccess your dashboard to:
Getting Help
|
dosubot
bot
added
the
size:L
TestGru AssignmentSummary
Tip You can |
|
Thank you for raising your pull request and contributing to our Community |
![sourcery-ai[bot]](https://avatars.githubusercontent.com/in/48477?s=60&v=4){kind=small}
There was a problem hiding this comment.
Hey @DarinVerheijke - I've reviewed your changes - here's some feedback:
- The
checkModelvalue (Qwen/Qwen2.5-32B-Instruct) isn’t present in your static model list—please reconcile or update it to avoid runtime lookup failures. - The Dockerfile env vars (
FEATHERLESS_API_KEY/FEATHERLESS_MODEL_LIST) don’t match the code’sFEATHERLESSAI_API_KEYnaming—please align these with other providers for consistency. - Maintaining 150+ static model entries will become hard to keep in sync—consider fetching the available Featherless AI model list dynamically instead.
Prompt for AI Agents
Please address the comments from this code review:
## Overall Comments
- The `checkModel` value (`Qwen/Qwen2.5-32B-Instruct`) isn’t present in your static model list—please reconcile or update it to avoid runtime lookup failures.
- The Dockerfile env vars (`FEATHERLESS_API_KEY` / `FEATHERLESS_MODEL_LIST`) don’t match the code’s `FEATHERLESSAI_API_KEY` naming—please align these with other providers for consistency.
- Maintaining 150+ static model entries will become hard to keep in sync—consider fetching the available Featherless AI model list dynamically instead.
## Individual Comments
### Comment 1
<location> `src/config/modelProviders/featherlessai.ts:5` </location>
<code_context>
+
+const FeatherlessAI: ModelProviderCard = {
+ chatModels: [],
+ checkModel: 'Qwen/Qwen2.5-32B-Instruct',
+ description: 'Featherless AI 通过单一 API 提供对超过 10,000 个开源模型的访问，并采用订阅式定价。',
+ disableBrowserRequest: true,
</code_context>
<issue_to_address>
The checkModel value does not match any model in the FeatherlessAI model list.
'Qwen/Qwen2.5-32B-Instruct' is not present in src/config/aiModels/featherlessai.ts. Please update checkModel to use a valid model ID from the FeatherlessAI model list to avoid potential verification or health check issues.
</issue_to_address>Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.
|
|
||
| const FeatherlessAI: ModelProviderCard = { | ||
| chatModels: [], | ||
| checkModel: 'Qwen/Qwen2.5-32B-Instruct', |
There was a problem hiding this comment.
issue (bug_risk): The checkModel value does not match any model in the FeatherlessAI model list.
'Qwen/Qwen2.5-32B-Instruct' is not present in src/config/aiModels/featherlessai.ts. Please update checkModel to use a valid model ID from the FeatherlessAI model list to avoid potential verification or health check issues.
|
@DarinVerheijke Hi please rebase the main, and the left is lgtm |
dosubot
bot
added
size:XXL
DarinVerheijke
force-pushed
the
featherless-provider
branch
from
2c9af76 to
5aa984d
Compare
dosubot
bot
added
size:L
Done and added the new oss open-ai one to model list @arvinxx |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
💻 变更类型 | Change Type
🔀 变更说明 | Description of Change
Adds Featherless AI as a provider giving access to over 10,000+ open-weight models
📝 补充信息 | Additional Information
Logo needs to be added
Currently added only the popular well known base models, by request I can add more that are available on the list here https://featherless.ai/models
Summary by Sourcery
Add Featherless AI as a new LLM provider to grant access to over 10,000 open-weight models in LobeChat
New Features:
Build:
Documentation: