LangSmith LLM Gateway: Runtime Controls for Agents

LangSmith LLM Gateway is now available in public beta. Agents in production need runtime controls over model calls to avoid undesirable outcomes like cost overruns and outages. Spend caps, rate limits, model fallbacks, and sensitive data protections are all important controls, but without the right tooling, engineers have to write these controls manually within each agent for a given model provider. That’s why we built LangSmith LLM Gateway. It’s the central governance layer that sits between your agents and the models they call, designed specifically for the controls that agent engineering teams need in production. LLM Gateway gives teams one place to enforce runtime controls across agents, models,…