langsmith-tracing

Solid

LangSmith tracing and debugging setup for LLM applications. Configure observability, capture traces, and enable debugging for LangChain/LangGraph agents.

AI & Automation 1,160 stars 71 forks Updated today MIT

Install

View on GitHub

Quality Score: 96/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# langsmith-tracing Configure LangSmith observability and tracing for LLM applications built with LangChain and LangGraph frameworks. ## Overview LangSmith is the managed observability suite by LangChain that provides: - Dashboards and alerting for LLM applications - Human-in-the-loop evaluation capabilities - Deep LangChain/LangGraph integration - Run Tree model for nested traces - MCP connectivity to Claude, VSCode ## Capabilities ### Core Tracing Setup - Initialize LangSmith client and API configuration - Configure project/workspace settings - Set up trace collection and sampling - Enable debug logging for agent execution ### Integration Patterns - LangChain chain tracing with automatic instrumentation - LangGraph workflow state tracking - Custom span creation for non-LangChain code - Parent-child trace relationships ### Debugging Features - Fetch execution traces for analysis - Query run history and metadata - Export traces for offline analysis - Compare runs across different versions ## Usage ### Environment Setup ```bash # Set required environment variables export LANGCHAIN_TRACING_V2=true export LANGCHAIN_API_KEY=<your-api-key> export LANGCHAIN_PROJECT=<project-name> ``` ### Python Integration ```python from langsmith import Client, traceable from langchain.callbacks.tracers import LangChainTracer # Initialize client client = Client() # Use @traceable decorator for custom functions @traceable(name="custom_operation") def my_function(input_data): # You...

Details

Author
a5c-ai
Repository
a5c-ai/babysitter
Created
4 months ago
Last Updated
today
Language
JavaScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

langsmith-observability

LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.

27,705 Updated today
davila7
AI & Automation Solid

langsmith-observability

LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.

9,182 Updated 1 months ago
Orchestra-Research
AI & Automation Featured

langchain-observability

Set up comprehensive observability for LangChain applications with LangSmith tracing, OpenTelemetry, Prometheus metrics, and alerts. Trigger: "langchain monitoring", "langchain metrics", "langchain observability", "langchain tracing", "LangSmith", "langchain alerts".

2,274 Updated today
jeremylongshore
AI & Automation Listed

langsmith-fetch

Debug LangChain and LangGraph agents by fetching execution traces from LangSmith Studio. Use when debugging agent behavior, investigating errors, analyzing tool calls, checking memory operations, or examining agent performance. Automatically fetches recent traces and analyzes execution patterns. Requires langsmith-fetch CLI installed.

1 Updated today
humongus69
AI & Automation Listed

langsmith-fetch

Debug LangChain and LangGraph agents by fetching execution traces from LangSmith Studio. Use when debugging agent behavior, investigating errors, analyzing tool calls, checking memory operations, or examining agent performance. Automatically fetches recent traces and analyzes execution patterns. Requires langsmith-fetch CLI installed.

62,764 Updated 1 weeks ago
ComposioHQ