> ## Documentation Index
> Fetch the complete documentation index at: https://docs.oumi.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# DIAGNOSING FAILURE MODES

> Identify patterns in your model results

## OVERVIEW

Oumi automatically extracts failure modes from evaluation results, identifying recurring patterns that explain why certain outputs did not meet the defined criteria. Instead of treating low scores as isolated incidents, failure modes surface systematic weaknesses (e.g., reasoning gaps, formatting errors, or unsafe responses), providing clear, actionable insight for the next iteration.

By clustering related errors, Oumi helps you focus on high-impact improvements across data, prompts, models, or evaluators. You can also generate a new dataset directly from an evaluator’s identified failure modes, enabling targeted data synthesis and creating a tight feedback loop between evaluation and model refinement.

## ACCESSING FAILURE MODES

To access the failure modes for a particular evaluation:

1. Go the the **Evaluation** page and click on the name of the evaluation.
2. Click on the `Review Failure Modes` button.
3. On the **Failure Modes** page, review each individual item as needed.

<video autoPlay controls muted loop playsInline allowFullScreen className="w-full aspect-video rounded-xl" src="https://mintcdn.com/oumi/-C82V_kXqoBIcXEj/videos/reviewing-failure-modes.mp4?fit=max&auto=format&n=-C82V_kXqoBIcXEj&q=85&s=6665fd1948eb8efeb1d697f8fba383b3" data-path="videos/reviewing-failure-modes.mp4" />

To generate a training dataset that targets specific issues, select the failure mode(s) in question and click `Generate Dataset`.
