cetra

Open-source LLM observability and evaluation.

cetra records the traces of LLM applications, measures their cost and latency, and evaluates their output. It runs as one binary on one machine: OpenTelemetry ingestion, its own storage engine, and a web UI, with Python and TypeScript SDKs.

cetra is in development and has not been released yet.