Skip to content

feat. add lepton ai #1034

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Apr 22, 2025
Merged

feat. add lepton ai #1034

merged 5 commits into from
Apr 22, 2025

Conversation

Ajay-Satish-01
Copy link
Contributor

@Ajay-Satish-01 Ajay-Satish-01 commented Apr 12, 2025

Code Quality new feature

Author Description

Title:

  • Add Lepton AI support

Related Issues:

Title:

  • Add Lepton AI support

🔄 What Changed

  • Added Lepton AI as a new provider in the gateway
  • Implemented API configuration for Lepton endpoints
  • Added support for chat completion, text completion, and transcription services
  • Implemented stream handling for both chat and text completions

🔍 Impact of the Change

  • Expands the gateway's capabilities by integrating Lepton AI as a new provider
  • Allows users to access Lepton's AI services through the existing gateway interface
  • Follows established patterns for provider integration, ensuring consistency

📁 Total Files Changed

  • 7 files changed (495 additions, 0 deletions)
  • 2 files modified: globals.ts, providers/index.ts
  • 5 files added: providers/lepton/* (api.ts, chatComplete.ts, complete.ts, createTranscription.ts, index.ts)

🧪 Test Added

  • N/A

🔒 Security Vulnerabilities

  • No security vulnerabilities identified
  • Proper API key handling through Authorization header

Related Issues:

Quality Recommendations

  1. Add unit tests for the Lepton provider integration to ensure proper functionality

  2. Add error handling for edge cases in stream chunk parsing

  3. Add JSDoc comments to explain the purpose and parameters of key functions

  4. Consider adding validation for Lepton-specific parameters

  5. Add logging for API request failures to aid in debugging

Copy link
Collaborator

@narengogi narengogi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, only one minor comment @Ajay-Satish-01

@VisargD VisargD merged commit 4f68e8f into Portkey-AI:main Apr 22, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants