Welcome to OpenGateLLM
OpenGateLLM is a production-ready, open-source API gateway that lets you self-host, orchestrate, and scale large-language models (LLMs) with advanced features like RAG, OCR, and audio transcription built-in.
🌐 OpenAI standards
Based on OpenAI API conventions. Easy to use with OpenAI SDKs, LangChain, LlamaIndex, etc
🚦 Robust API Gateway
Load balancing, authentication, and seamless integration with OpenAI, vLLM, HuggingFace TEI.
📖 Open Source
Developed by the French Government, fully open-source forever.
⚙️ Production-ready
Ready to serve your models in production.
📚 Full stack genAI API
Built-in Retrieval-Augmented Generation (RAG), OCR, audio transcription, and more.