LangDB

LangDB is an enterprise-grade AI gateway and agent observability platform fully built in Rust, providing unified access to 250+ large language models (LLMs) through a single OpenAI-compatible API. The platform is designed for developers and enterprises building production AI applications, offering features such as real-time LLM analytics, intelligent traffic routing across models, and comprehensive agent tracing for frameworks including LangChain, Google ADK, and OpenAI. LangDB's Rust foundation delivers performance and scalability that Python- or JavaScript-based gateways cannot match. The platform also provides an open-source observability stack (vLLora) and a Virtual MCP layer enabling natural language queries against databases like ClickHouse without writing SQL.