Skip to main content

OVERVIEW

The Oumi Agent can read your deployment’s operational health on demand. Ask how a deployment is doing and it reports traffic volume, error rate, latency percentiles, and token throughput, then pairs that with quality monitoring scores to tell you whether a problem is operational or a real quality regression. The same data lives on the deployment’s Health tab, so you get serving observability without wiring up an external metrics stack. Every managed deployment with inference logging enabled reports health metrics automatically.

THE HEALTH TAB

Open a deployment and select the Health tab. A summary row shows the numbers for the visible window: Below it, five charts break the window into time buckets: The Time window selector zooms from 1 hour out to 30 days, with a Custom option for an exact range. The tab shows up to 30 days of history. Charts support pan and zoom, and each card can be refreshed, expanded, or saved.

WHAT’S NEXT

Quality monitoring

Score sampled production traffic with LLM judges and track quality trends.

Inference logs

Inspect the individual requests behind the metrics.