Skip to content
@truefoundry

TrueFoundry

Build fast, secure and cost-efficient ML/LLM Apps

TrueFoundryTrueFoundry

TrueFoundry - Reduce time to value on Gen AI & ML initiatives

Twitter Follow Artifact Hub YouTube Slack Signup

What is TrueFoundry?

  • A low-latency enterprise AI Gateway with MCP server integrations, guardrails, observability, latency-based routing, model fallback, caching, quota and access control (on-premise, VPC or cloud).
  • A cloud-agnostic PaaS running on Kubernetes that standardizes AI applications development, deployment and observability using developer-friendly APIs. Plugs and play with your existing stack without vendor lock-in bringing state of the art industry standards.

Govern, Deploy, Scale & Trace Agentic AI in One Unified Platform

  • NEW 🔥 Free Sign Up - Sign Up for Free and Deploy on your cloud in under 10 minutes
  • AI Gateway - Enterprise-Ready AI Gateway for secure, high-performance proxy to 1000+ models with observability, governance, rate limits, budgets, guardrails, fallbacks, and load balancing.
  • NEW 🔥 MCP Gateway - Secure Access to MCP Servers and Agent Orchestration
  • NEW 🔥 Tracing - End-to-End Observability for AI Agents and Applications
  • AI Engineering - One platform to deploy services, jobs, notebooks, track experiments, train/serve models, and ship DAG workflows.
  • TrueFoundry SDK & CLI - Python/TypeScript SDKs & CLI for programmatic control
    • Track Experiments, register and versions models, artifacts and prompts
    • Deploy Services, Jobs, Notebooks, SSH Servers, Helm applications
    • Build and Deploy DAG workflows
    • Enable CI/CD for your deployments
    • Programmatically access TrueFoundry APIs
  • TrueFoundry Docs - Guides and API Reference for the platform

OpenSource

  • KubeElasti - Kubernetes-native scale-to-zero with zero traffic loss, no code changes, and direct integration with kubernetes resources
  • LLM Locust - LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking
  • Cognita - RAG Framework for Building Grounded Applications

Get in touch 💬

👉 Join our Slack community!

🐦 Follow the latest from TrueFoundry team on Twitter @truefoundry

Pinned Loading

  1. cognita cognita Public

    RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

    Python 4.3k 358

Repositories

Showing 10 of 86 repositories

Most used topics

Loading…