R071 · Agent principles and patterns › Agent interaction protocols

Uber's MCP Gateway: turning 10,000 services into agent tools

Read the original

agents-at-scalemcp-gatewayagent-authcontext-engineeringagent-platforms

Sources: Alok Srivastava, Deepanshu Mehndiratta and Gaurav Gill, Designing MCP Gateway: Uber's MCP Management Platform, Uber Engineering blog, 1 Oct 2026. Surfaced by Rohit Jain on LinkedIn, 2026-11-13, who also points to Uber's talk "How Uber runs 60,000 AI agent tasks per week" and the post "Solving the Identity Crisis for AI Agents". The 60,000 weekly executions and 10,000 services figures come from that post and talk; the 800 servers and 5,000 tools figures are in the blog.

The problem

Early MCP use at Uber was team by team. Integrations were duplicated, tools were hard to find, and there were no shared security guarantees. Pointing every agent at every service directly would not scale for security or upkeep.

Architecture

Two parts:

Discovery: AutoCrawler

A scheduled Cadence workflow watches Uber's IDL registry and service signals for new services, APIs and schema changes. For each Protobuf or Thrift service it:

  1. Creates or updates a virtual MCP server for the service.

  2. Parses the IDL to get methods, request and response schemas, and doc comments.

  3. Uses an LLM to write tool descriptions, then registers the tools.

Native MCP servers and third-party MCP servers are registered alongside, and teams can author and enable tools in a UI.

Execution

For IDL-backed tools the gateway keeps an in-memory map to the downstream endpoint. It converts the JSON payload to Protobuf or Thrift, calls the service over HTTP, gRPC or TChannel, and translates the reply back to MCP.

Security

Fixing context load

MCP has no cross-server search, and wiring hundreds of servers into an agent would fill its context. Three mechanisms address this:

Scale

The blog reports over 800 MCP servers and over 5,000 tools on the gateway.

What to take from it

Caveats

Connections

See R071 on the knowledge map

Part of the Research notes on nowucca.com. Figures and claims are the source's own unless the summary says otherwise.