Skip to content

Commit e248a40

Browse files
Push new model catalog pages
1 parent 255520f commit e248a40

File tree

11 files changed

+1794
-834
lines changed

11 files changed

+1794
-834
lines changed

docs.json

Lines changed: 1705 additions & 777 deletions
Large diffs are not rendered by default.

product/ai-gateway/virtual-keys.mdx

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,7 @@
11
---
22
title: "Virtual Keys"
33
description: "Portkey's virtual key system allows you to securely store your LLM API keys in our vault, utilizing a unique virtual identifier to streamline API key management."
4+
tag: "Deprecated"
45
---
56

67
<Warning>

product/integrations.mdx

Lines changed: 25 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -1,52 +1,56 @@
11
---
2-
title: Integrations
2+
title: LLM Integrations
33
description: A step-by-step guide for organization admins to set up their first integration.
44
---
55

6-
# **Org Admin Quickstart: Setting Up Your First Model Catalog Integration**
6+
The **Integrations** page is the central command center for Organization Admins. It's where you securely manage all third-party LLM provider credentials and govern their use across all workspaces from a single, unified dashboard.
77

8-
As an Organization Admin, the Model Catalog gives you the power to centrally manage, provision, and govern all AI models used across your company. This guide will walk you through creating your first centralized integration.
8+
This "create once, provision many" model saves significant time, reduces configuration errors, and gives you complete oversight of your AI stack.
99

10-
**Prerequisite:** The Model Catalog feature has been enabled for your organization by the Portkey team.
10+
### **Understanding the Integrations Dashboard**
1111

12-
### **Navigating to the Integrations Hub**
12+
The Integrations page is organized into three tabs, each serving a distinct purpose:
1313

14-
1. Click on your organization name in the bottom-left corner of the sidebar.
15-
2. In the menu that appears, select **Integrations**. This is your new central dashboard for all provider connections.
14+
* **`All`**: This is a comprehensive list of all 50+ providers Portkey supports. This is your starting point for connecting a new provider to your organization.
15+
* **`Connected`**: This tab lists all the integrations that you have personally connected at the organization level. It's your primary view for managing your centrally-governed providers.
16+
* **`Workspace-Created`**: This tab gives you complete visibility and governance over any integrations created *by Workspace Admins* for their specific workspaces. It ensures that even with delegated control, you maintain a full audit trail and can manage these instances if needed.
1617

17-
18+
---
19+
20+
### **Creating and Provisioning a New Integration**
21+
22+
This guide walks you through connecting a new provider and making it available to your workspaces.
1823

19-
### **Step 1: Connect a New Provider Integration**
24+
#### **Step 1: Connect the Provider**
2025

21-
This step is similar to creating a Virtual Key, but it's happening at the organization level.
26+
<Info>
27+
If you are an existing Portkey user, this step is similar to creating a Virtual Key, but it's happening at the organization level.
28+
</Info>
2229

23-
1. From the **Integrations** page, find the provider you want to connect (e.g., OpenAI, Azure OpenAI, AWS Bedrock) and click **Connect**.
30+
1. From the **`All`** tab, find the provider you want to connect (e.g., OpenAI, Azure OpenAI, AWS Bedrock) and click **Connect**.
2431
2. Fill in the details:
2532
* **Integration Name:** A friendly name for you to identify this connection (e.g., "Azure Production - US East").
2633
* **Slug:** A unique, URL-friendly identifier. This will be used by developers to call models (e.g., `azure-prod-useast`).
2734
* **Credentials:** Securely enter your API keys or other authentication details. These are encrypted and will not be visible after saving.
2835
3. Click **Next**.
2936

30-
### **Step 2: Provision the Integration to Workspaces**
37+
#### **Step 2: Provision to Workspaces**
3138

3239
Here, you decide which teams get access to this provider and under what conditions.
3340

3441
1. You will see a list of all workspaces within your organization.
3542
2. Use the toggle next to a workspace name to **enable or disable** access.
3643
3. For each enabled workspace, you can optionally click **Edit Budget & Rate Limits** to set specific spending caps or request limits that apply *only to that workspace* for this integration.
37-
4. **(Optional) For New Workspaces:** Toggle on **"Automatically provision this integration for new workspaces"** to ensure any future teams automatically get access with a default budget/rate limit you define.
44+
4. **(Optional) For Provisioning to New Workspaces:** Toggle on **"Automatically provision this integration for new workspaces"** to ensure any future teams automatically get access with a default budget/rate limit you define.
3845
5. Click **Next**.
3946

40-
47+
#### **Step 3: Provision Specific Models**
4148

42-
### **Step 3: Provision Specific Models**
43-
44-
This is where you enforce model governance.
49+
This is where you enforce model governance and control costs.
4550

4651
1. You will see a list of all models available from the provider you're connecting.
47-
2. By default, all models may be selected. You can **Clear all** and then select only the models you wish to approve for use.
48-
3. **(Optional) For Dynamic Models:** If you're using a provider like Fireworks AI with many community models, you can toggle on **"Automatically enable new models"**. This is useful, but for providers like OpenAI or Azure, we recommend an explicit allow-list for better cost control.
52+
2. You can **Clear all** and then select only the models you wish to approve for use.
53+
3. **(Optional) For Dynamic Models:** If you're using a provider like Fireworks AI with many community models, you can toggle on **"Automatically enable new models"**. For providers like OpenAI or Azure, we recommend an explicit allow-list for better cost control.
4954
4. Click **Create Integration**.
5055

51-
**That's it!** You have successfully created a centrally managed integration. The workspaces you provisioned will now see this as an available "AI Provider" in their Model Catalog, with access only to the models you specified and constrained by the budgets you set. You can now repeat this process for all your providers.
52-
56+
**That's it!** You have successfully created and provisioned a centrally managed integration. It will now appear in your **`Connected`** tab. The workspaces you provisioned will see this as an available "AI Provider" in their Model Catalog, with access only to the models you specified and constrained by the budgets you set.

product/integrations/agents.mdx

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
---
2+
title: Agents
3+
url: /integrations/agents
4+
---

product/integrations/ai-apps.mdx

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
---
2+
title: AI Apps
3+
url: /integrations/ai-apps
4+
---

product/integrations/cloud.mdx

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
---
2+
title: Cloud Providers
3+
url: /integrations/cloud
4+
---

product/integrations/guardrails.mdx

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
---
2+
title: Guardrails
3+
url: /product/guardrails/list-of-guardrail-checks
4+
---

product/integrations/libraries.mdx

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
---
2+
title: Libraries
3+
url: /integrations/libraries
4+
---

product/integrations/plugins.mdx

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
---
2+
title: Gateway Plugins
3+
url: /integrations/plugins
4+
---

product/integrations/tracing.mdx

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
---
2+
title: Tracing
3+
url: /integrations/tracing
4+
---

0 commit comments

Comments
 (0)