What is LLM observability?

LLM observability is the practice of capturing detailed traces of LLM calls in production, including prompts, responses, latencies, costs, retrieved context, and tool calls. It enables debugging individual failures, identifying patterns across requests, and optimizing prompts and models over time. Tools include LangSmith, LangFuse, Arize Phoenix, and Helicone.