πŸ“Š

LangSmith

LLM observability & eval β†— langchain.com

Tracing, evaluation, and monitoring platform from the LangChain team.

Category: Observability & Infra Β· Type: LLM observability & eval Β· Website: https://www.langchain.com/langsmith

Overview

LangSmith provides end-to-end tracing, dataset-based evaluation, prompt management, and production monitoring for LLM apps and agents. It works with LangGraph/LangChain and any framework via SDK.

Key Features

  • Detailed agent/LLM run tracing
  • Evals, datasets, and experiments
  • Prompt management and playground
  • Production monitoring and dashboards

Role in the Agentic AI Stack

The observability companion to LangGraph; competes with Langfuse for agent tracing/eval.

Part of Agentic AI Landscape β†’ Observability & Infra