agentgateway

agentgateway

by Solo.io, donated to the Linux Foundation — now hosted under the Agentic AI Foundation (AAIF) as an LF Projects, LLC project

One binary for service traffic, LLM routing, and agent protocol traffic.

See https://agentgateway.dev/

Open-source HTTP/gRPC gateway built as a unified data plane for AI-native
infrastructure, so teams no longer need separate gateways for services, LLM routing,
and agent-to-agent communication.

Features

• Routes HTTP/2, gRPC, and TCP services, plus multi-LLM-provider traffic (OpenAI, Claude, Gemini, etc.)
• Native protocol support for MCP and agent-to-agent (A2A) traffic — treats MCP servers as discoverable microservices with tool-level access control and audit trails
• Security: JWT/OIDC auth, API key management, mTLS, policy enforcement, PII redaction
• Observability: OpenTelemetry integration, token metrics, USD-denominated cost tracking
• Cost controls: budget limits, token caps, per-team spend attribution, pricing catalogs
• Governance: tool access policies, prompt guards, MCP guardrails
• Deploys as a standalone binary, via Docker, or on Kubernetes

Superpowers

Consolidates the service gateway, LLM gateway, and agent gateway into one component,
cutting the operational overhead of running three separate layers while adding the
governance and observability production agentic-AI deployments need. As of the
2026-09-01 AgentDesktop launch, the two are explicitly complementary:
AgentDesktop supplies user and device identity from the desktop fleet, and agentgateway
consumes that identity to handle credential injection, policy enforcement, and usage
logging on the traffic side.

Contributed to by Microsoft, AWS, Alibaba, Adobe, Cisco, and Salesforce among others;
publicly endorsed by Dell (John Roese), CoreWeave, T-Mobile, UBS, and TUF creator Justin
Cappos.

Pricing

Open source, free — self-hosted via binary, Docker, or Kubernetes.

See Also

• AgentDesktop — supplies the user/device identity agentgateway consumes for credential injection
• Agentic AI Foundation — the Linux Foundation body now governing agentgateway