← Claude Docs

Roll out an LLM gateway for your organization - Claude Code Docs

Claude Docs · June 25, 2026
An administrator guide details the process for deploying an LLM gateway for Claude Code, requiring a deployed gateway, provider credentials, and a mechanism to distribute settings to developer machines. The gateway must accept supported API formats, stream responses, route Claude model names, forward headers unchanged, and return upstream errors unmodified. The rollout involves five steps: confirming model routing, issuing developer credentials, testing Claude Code against the gateway, distributing configuration, and verifying the setup from developer machines.

Detailed Analysis

Anthropic's Claude Code documentation provides administrators with a structured framework for deploying an LLM gateway that mediates all Claude API traffic within an organization, replacing direct developer access to the Anthropic API with a centrally managed proxy layer. The documentation outlines a five-step rollout process — confirming model routing, issuing developer credentials, testing against the gateway, distributing configuration, and verifying from endpoint machines — and distinguishes between three distinct credential types: provider credentials held by the gateway itself, administrative credentials held by the IT operator, and per-developer keys issued through the gateway's own credential management system. This separation of credential concerns is central to the enterprise use case the document addresses, enabling organizations to control and audit AI usage without exposing upstream provider credentials to individual developers.

The technical requirements detailed in the documentation reveal important architectural constraints that any compliant gateway product must satisfy. Gateway implementations must pass server-sent events through in real time rather than buffering full responses, preserve specific Anthropic headers like `anthropic-beta` and `anthropic-version` without modification, forward upstream error messages verbatim rather than wrapping them in custom envelopes, and exempt Claude Code traffic from Web Application Firewall body inspection. This last requirement is particularly notable: the documentation acknowledges that Claude Code prompts routinely contain source code and XML-style tags that trigger cross-site scripting detection rules in standard WAF configurations, causing legitimate sessions to return 403 errors while short test requests pass unimpeded — a subtle failure mode that could mislead administrators during initial validation.

The gateway architecture described reflects a broader organizational pattern in enterprise AI adoption, where security, compliance, and cost governance teams require a chokepoint through which all model traffic flows. By routing requests through a gateway, organizations gain the ability to enforce usage policies, log interactions for audit purposes, rotate or revoke credentials at scale, and potentially implement content filtering or cost controls without modifying individual developer tooling. The document's support for multiple upstream providers — including Amazon Bedrock, Google Vertex AI, and Microsoft Foundry alongside the direct Anthropic API — signals that the gateway abstraction is designed to remain stable even as organizations shift between or combine underlying model providers.

The documentation's emphasis on checkpoint validation at each rollout step, with explicit guidance on interpreting specific HTTP status codes such as 404 for unrouted model names and 401 for misconfigured provider credentials, reflects a maturation in how Anthropic is packaging Claude Code for enterprise deployment. Rather than leaving failure diagnosis to trial and error, the structured checkpoint approach allows administrators to isolate whether failures originate at the gateway configuration layer, the provider credential layer, or the developer key issuance layer. This level of operational specificity indicates that Claude Code is increasingly being positioned not just as a developer productivity tool but as an organizational infrastructure component requiring the same deployment rigor as other enterprise software systems.

Read original article →