GitHub Models: Scale Beyond Limits

[Akash1134]

We've just unlocked new possibilities for your AI-powered development journey. GitHub Models now offers two flexible paths to scale beyond the free tier: pay-as-you-go billing through your GitHub account and bring your own key (BYOK).

These new options streamline access to production-grade AI models, making it easier to build with AI across your development workflow, whether your team standardizes on GitHub billing or prefers to manage its own provider keys.

What's new

Billing for Model Inference:

• Production-ready inference: Access higher-capacity, enterprise-grade model usage beyond free rate limits for models from DeepSeek, Meta, Microsoft, and OpenAI.
• Seamless billing: Pay using payment methods such as credit card, PayPal, or invoice.
• Start free, then scale: No complex setup or extra infrastructure required. Model access is free within our rate limits, allowing you to experiment before transitioning to paid usage as your needs grow.
• Enterprise-ready governance: Your data stays secure on GitHub and Azure infrastructure and is never leveraged for training. Org-level controls let you manage which models are available to your team.

Bring Your Own Key (BYOK):

• Provider flexibility: Connect your own keys from OpenAI or Azure AI with usage billed against your provider account.
• Fully integrated: Use your own models across prompts, evaluations, the Playground, and GitHub Actions—seamlessly within your existing workflow.
• Secure access: Share model usage across your team without exposing sensitive API keys.

For implementation details, see our Billing documentation and BYOK documentation.

To learn more about GitHub Models, visit the GitHub Models documentation and join the discussion below to share feedback and connect with other developers. 🚀

[Manouchehri]

Great start!

We really need two features:

1. Custom api_base support, so we can BYOP (Bring Your Own Provider).
2. For Azure OpenAI, OIDC authentication would be much better than static API keys (which we have disabled). https://learn.microsoft.com/en-us/azure/api-management/api-management-authenticate-authorize-azure-openai#oauth-20-authorization-using-identity-provider

[Manouchehri]

We also need support for the Responses API in BYOK. :)

[ushuz]

BYOK doc link is dead, returns 404.