One-click deploy
The easiest way to deploy LLM applications. Connect your GitHub repo and deploy in a single click, with LangSmith tracing and observability automatically built in on every request.
Getting to production just got easier. Built with FastAPI, LangServe gives you an API, docs, and a playground for your LangChain apps.
Hosted LangServe is Currently in Beta.
Discover, download, and remix templates for a wide range of use-cases ready to be deployed using LangServe.
Hosted LangServe comes with a built in playground and docs site that you can share with your colleagues to try out the application and get feedback faster.
Hosted LangServe integrates with GitHub, so once you connect LangServe to your repository, the service will take care of spinning up a container to run your application.
Hosted LangServe is deeply integrated into LangSmith by default. All inputs / outputs from your server are automatically logged to LangSmith, so you can easily debug issues and understand your chain’s behavior.
Hosted LangServe will show you the exact branch and commit deployed at any given time and how that version of your application is performing.
Get documentation for your LangServe application built automatically, so that your users and collaborators can take advantage of all the supported endpoints.
The easiest way to deploy LLM applications. Connect your GitHub repo and deploy in a single click, with LangSmith tracing and observability automatically built in on every request.
Hosted LangServe applications are hosted in GCP us-central-1.
You will receive access to invoke, batch, and stream endpoints that mirror the functionality of the Runnables API. You will also receive access to a feedback endpoint where you can add user feedback to runs. For a full list of endpoints, please click on your deployment's URL in your hosted LangServe application, which will redirect to the accompanying docs page.
Not at the moment since the product is still in beta.
We support up to 1GB of memory on each deployment. If you have a use case that requires more memory, please reach out to hosted-langserve@langchain.dev with your specific use case.
LangChain and LangSmith are critical parts of the reference architecture to get you from prototype to production.