OpenLIT

Resources

Blogs

openlitopentelemetry

Talk to Your Telemetry: Debugging LLMs with OpenLIT's Otter AI Copilot

A deep dive into OpenLIT's Otter AI Copilot—the tool-calling assistant that lets you query traces, write Rule Engine rules, manage the Prompt Hub, and register custom model pricing conversationally.
Aman Agarwal•July 8, 2026
Talk to Your Telemetry: Debugging LLMs with OpenLIT's Otter AI Copilot
Observability for LLM Apps and Agents: OpenLIT SDK + VictoriaMetrics Observability Stack
openlitvictoriametrics

Observability for LLM Apps and Agents: OpenLIT SDK + VictoriaMetrics Observability Stack

A joint OpenLIT + VictoriaMetrics guide to observability for LLM apps and agents - OTel GenAI semantic conventions, PromQL queries for cost, recursion, and cache hit rate, alerting rules that earn their keep, and a fully self-hosted, vendor-neutral pipeline for metrics, traces, and logs.
Aman Agarwal•July 3, 2026
How to Detect Hallucinations in Your RAG Pipeline (with Code Examples)
openlitrag

How to Detect Hallucinations in Your RAG Pipeline (with Code Examples)

Catch LLM hallucinations programmatically using OpenLIT's evaluation SDK. Includes Python code examples for hallucination, toxicity, and bias detection with OpenTelemetry export.
Openlit•April 7, 2026
Tracking LLM Costs in Production: Per-Model, Per-Request, Per-User Attribution
openlitcost-tracking

Tracking LLM Costs in Production: Per-Model, Per-Request, Per-User Attribution

Break down LLM costs by model, service, user, and environment using OpenLIT. Auto-calculated token costs exported as OpenTelemetry metrics to Grafana, Datadog, or any backend.
Openlit•March 31, 2026
GPU Monitoring for LLM Inference: What to Track and Why It Matters
openlitgpu

GPU Monitoring for LLM Inference: What to Track and Why It Matters

Learn which GPU metrics matter for LLM inference workloads and how to collect them as OpenTelemetry signals using OpenLIT's GPU collector. Supports NVIDIA and AMD.
Openlit•March 27, 2026
How to Add Observability to Your LLM App in 2 Minutes with OpenTelemetry
openlitopentelemetry

How to Add Observability to Your LLM App in 2 Minutes with OpenTelemetry

Add full tracing, metrics, and cost tracking to any LLM application with one line of code using OpenLIT and OpenTelemetry. Works with OpenAI, Anthropic, and 40+ providers.
Openlit•March 26, 2026
Fleet Hub Playbook for Multi-Region AI Observability
openlitopentelemetry

Fleet Hub Playbook for Multi-Region AI Observability

Coordinate fleets of OpenTelemetry collectors for GenAI workloads with OpenLIT Fleet Hub and the OpAMP protocol.
Aman Agarwal•November 7, 2025
Monitoring LLM Usage in OpenWebUI with OpenLIT
openlitopen-webui

Monitoring LLM Usage in OpenWebUI with OpenLIT

This guide walks you through integrating OpenLIT with OpenWebUI using pipelines, covering installation, configuration, and practical use cases for monitoring and observability of LLMs including token tracking, cost analysis, and GPU metrics.
wolfgangsmdt•February 28, 2025
How to protect your OpenAI/LLM Apps from Prompt Injection Attacks
openlitlangchain

How to protect your OpenAI/LLM Apps from Prompt Injection Attacks

Learn how to safeguard your OpenAI and LLM apps from prompt injection attacks using UUIDs, input validation, and monitoring strategies with OpenLIT.
Aman Agarwal•October 23, 2024
Unlocking Seamless GenAI & LLM Observability with OpenLIT
openlitllm

Unlocking Seamless GenAI & LLM Observability with OpenLIT

OpenLIT offers seamless, OpenTelemetry-native observability for GenAI and LLMs, simplifying performance and cost tracking.
Aman Agarwal•August 15, 2024
Designing an Observability Pipeline for LLM Applications
openlitllm

Designing an Observability Pipeline for LLM Applications

Observability for LLMs ensures performance, user insights, and GPU monitoring. Learn how to design and implement a complete observability pipeline for your LLM applications.
Aman Agarwal•August 15, 2024