LangChain has introduced Custom Apps in LangSmith, allowing teams to build and publish their own interfaces over agent traces, experiments, annotations and evaluation results. The apps run inside a LangSmith workspace, so developers do not need to set up separate hosting, authentication, permissions and sharing for each internal tool.
Users can start from templates and work against the LangSmith API with a coding agent. Plus and Enterprise customers can also describe the data and layout they want through LangSmith Chat, which generates a working interface. Once published, the app remains connected to workspace data and can be reused by teammates.
The feature is aimed at recurring review processes that do not fit a generic dashboard. A subject expert could see a request, response, evidence and scoring rubric while an engineer keeps access to full tool calls and metadata. Teams could also compare prompt versions, examine failures by customer segment or create a focused view for checking an agent’s tone and policy compliance.
Custom Apps are available now on Plus and Enterprise plans. Plus includes one app per organization, while Enterprise includes unlimited apps. The launch reduces the infrastructure needed for internal review tools, but teams still have to design the criteria and workflows that determine whether an agent’s behavior is acceptable.