Langtrace

Where it runs

• Web
• API

Tags

• #observability
• #tracing
• #opentelemetry
• #open-source
• #evals

• View Galileo details

  ObservabilityFREEMIUM

  GA

  Galileo

  Galileo

  Evaluation and observability for GenAI apps and agents, with inline guardrails.

  A platform for testing, monitoring, and guardrailing LLM and agent applications. It ships 20+ out-of-the-box evals for RAG, agents, and safety, lets teams author custom evaluators, and turns those offline evals into real-time production guardrails powered by its own Luna eval models.

  AI insight: Scores traces with its own small 'Luna' evaluation models rather than an LLM-as-judge, keeping inline production guardrails cheap to run.

  • evaluation
  • observability
  • guardrails
  • agents

  Open
• View Traceloop details

  ObservabilityFREEMIUMOpen core

  TR

  Traceloop

  Traceloop

  LLM observability built on OpenTelemetry.

  A reliability platform for LLM apps: its open-source OpenLLMetry SDK instruments LLM, vector-DB, and framework calls as standard OpenTelemetry spans, which Traceloop's hosted dashboard turns into traces, cost/latency analytics, and quality monitoring. Because the data is plain OTel, you can pipe it to existing observability stacks instead of a proprietary one.

  AI insight: OpenLLMetry builds on OpenTelemetry, so traces export to Datadog, Honeycomb or any OTel backend — not only Traceloop's dashboard.

  • observability
  • opentelemetry
  • tracing
  • open-source
  • +1

  Open
• View W&B Weave details

  ObservabilityFREEMIUMOpen core

  WB

  W&B Weave

  Weights & Biases

  Tracing and evaluation for LLM apps, from Weights & Biases.

  An observability and evaluation toolkit for generative-AI applications. A single @weave.op decorator traces every model call — capturing inputs, outputs, latency, token cost, and errors — and the same SDK builds rigorous evaluations using LLM-as-judge and custom scorers. Traces and experiments are organized in the Weights & Biases web platform for side-by-side comparison across prompts and models.

  AI insight: The SDK is Apache-2.0 open source, but the traces it captures land in W&B's hosted platform — free for solo use.

  • llm-observability
  • tracing
  • eval
  • open-source
  • +1

  Open
• View Opik details

  ObservabilityFREEMIUMOpen core

  OP

  Opik

  Comet

  Open-source LLM evaluation, tracing, and monitoring.

  Open-source platform from Comet for debugging and evaluating LLM and agent apps: full tracing of calls, tools, and agent steps, LLM-as-a-judge and heuristic evals, prompt management, and production dashboards. Self-host via Docker or Kubernetes, or use Comet's hosted cloud.

  AI insight: Apache-2.0 and fully self-hostable — a langfuse-style tracing-plus-eval platform you own, with an optional Comet-hosted cloud.

  • observability
  • evaluation
  • tracing
  • open-source

  Open
• View Arize Phoenix details

  ObservabilityFREEMIUM

  AR

  Arize Phoenix

  Arize AI

  LLM tracing + evaluation. Strong on retrieval debugging.

  Phoenix is Arize's observability platform — run locally in a notebook or as a hosted service. Especially strong for inspecting RAG pipelines, finding bad chunks, and tracking retrieval quality over time.

  AI insight: Spins up inside a Jupyter notebook and is sharpest at RAG debugging — finding the bad chunk that poisoned a retrieval.

  • tracing
  • rag
  • retrieval-debugging

  Open
• View Helicone details

  ObservabilityFREEMIUMOpen core

  HE

  Helicone

  Helicone

  Drop-in LLM proxy with logging, caching, and cost tracking.

  One-line integration — change your OpenAI/Anthropic base URL and get a dashboard with every prompt, response, latency, and dollar tracked. Adds caching and rate-limit handling without code changes.

  AI insight: Integrate by changing one base-URL line — no SDK wrapper — and it's open-source, so you can self-host the proxy.

  • proxy
  • logging
  • caching
  • cost-tracking

  Open
• View Langfuse details

  ObservabilityFREEMIUMOpen core

  LA

  Langfuse

  Langfuse

  Open-source LLM observability. Self-hostable, OpenTelemetry-native.

  Tracing, evals, prompt management, and dataset tooling for LLM apps — self-host on your own infra or use Langfuse Cloud. The open-source default when you want full ownership of your observability stack.

  AI insight: The self-hostable, OpenTelemetry-native answer to LangSmith — pick it when observability data has to stay on your own infra.

  • open-source
  • tracing
  • evals
  • self-hosted

  Open
• View LangSmith details

  ObservabilityFREEMIUM

  LA

  LangSmith

  LangChain

  LangChain's hosted observability + eval platform.

  Tracing, dataset management, eval orchestration, and prompt playground from the LangChain team. Pairs naturally if LangChain or LangGraph already runs in your stack, but works standalone via SDKs.

  AI insight: Despite the name it works without LangChain in your stack — but it's cloud-only, where Langfuse lets you self-host.

  • tracing
  • evals
  • datasets
  • langchain

  Open