LangSmith LLM Gateway Private Beta Waitlist
LLM Gateway is a runtime governance layer for AI agents. It sits between your agents and the LLM providers they call, enforcing cost limits and detecting sensitive data before damage happens. Surface every policy event in the same LangSmith workspace where you already build, observe, and evaluate your agents.
LangSmith LLM Gateway includes:
- Spend visibility with real-time cost rollups by team, project, and developer
- Audit logging of every policy event, with the requesting identity, the policy that fired, and a link to the trace
- PII and secrets detection that redacts sensitive data before it reaches the model or your traces
- Issues Board integration so policy violations land in the same triage workflow you already use
- Trace continuity so every gateway-proxied call appears in your existing LangSmith workspace
- OSS integrations
Now in Private Beta. Join the waitlist for access.
Trusted by the best teams building agents
