Announcements, releases, and deep dives
Stories from the Agent Router community — and the Envoy AI Gateway years before it.
Announcing the Envoy AI Gateway v0.3 Release
Envoy AI Gateway v0.3 brings intelligent inference routing with Endpoint Picker, production-ready Google Vertex AI support, and enterprise observability with OpenInference tracing—transforming AI infrastructure from static to intelligent.
Aug 22, 2025 · 8 min read
Envoy AI Gateway Introduces Endpoint Picker Support
Envoy AI Gateway introduces Endpoint Picker Provider support for intelligent inference routing based on real-time AI metrics like KV-cache usage and queue depth—moving beyond traditional load balancing to optimize AI workload performance.
Jul 30, 2025 · 7 min read
A Reference Architecture for Adopters of Envoy AI Gateway
Explore how to build a scalable GenAI platform using a two-tier architecture with Envoy AI Gateway. Centralize access to external and self-hosted LLMs through a unified API while managing credentials, costs, and governance.
Jul 15, 2025 · 7 min read
Announcing the first Envoy AI Gateway Release – A Community Milestone!
On February 25, 2025 Envoy AI Gateway v0.1 was Released. The first AI gateway built on CNCF Envoy Gateway, delivering unified LLM API access, upstream authorization, and token-based rate limiting to simplify enterprise AI adoption.
Feb 25, 2025 · 3 min read
End User Keynote at KubeCon 2024
Watch the KubeCon 2024 End User Keynote featuring Envoy AI Gateway—learn how Bloomberg and Tetrate are centralizing enterprise AI workflows with unified model access, usage limiting, and upstream authorization at scale.
Nov 14, 2024 · 1 min read
Introducing Envoy AI Gateway
Open collaboration to bring AI Gateway features to the Envoy community
Oct 18, 2024 · 3 min read