Skip to main content
A row with an empty turn or a missing user message can fail training or teach a model the wrong pattern. Oumi runs quality tests on every new version of a dataset, whether you upload it, generate it, delete rows, or restore a version. The tests flag the rows with structural problems, so you can remove them before you train or evaluate. Quality tests check structure, not content. They don’t detect wrong answers, duplicate rows, or repetitive phrasing. To check content, read rows in Data Explorer, or run an evaluation.

​
THE QUALITY TESTS

​
REVIEW THE RESULTS

  1. On the Datasets page, click the status in the Quality Tests column, such as 3/5 Tests Passed. You can also open the dataset and click the Quality Tests tab.
  2. Expand a test to see the rows that failed it and the reason for each failure.
  3. Click a row to open the conversation.
Quality Tests tab with four failed tests and the Empty turns detected test expanded to show its two failed rows Read a few flagged rows before you remove them. A flagged row can still be useful. For example, keep long rows if your model supports long context. To analyze the results outside Oumi, click Export Quality Tests and choose JSONL or Parquet.

​
STATISTICS

The Statistics tab summarizes the dataset as a whole. For each metric, such as tokens per row, turns per row, and tool turns, it shows the minimum, median, maximum, and total. Use it to check that the dataset matches what you expect, such as the number of turns in a multi-turn dataset, or the token count against your model’s context window.

​
REMOVE FAILED ROWS

  1. On the Quality Tests tab, click Delete Failed Rows.
  2. Select the tests whose failed rows you want to remove.
  3. Choose where to save the result:
    • Save to New Dataset creates a separate dataset without the failed rows, and leaves this dataset unchanged. Choose it when evaluations or training runs use this dataset and should keep using the original.
    • Delete Rows removes the rows in a new version of this dataset. Oumi runs the quality tests again on the new version.
Delete Failed Rows dialog with four failed tests selected and the Save to New Dataset and Delete Rows buttons Delete Failed Rows appears only on the latest version. Delete Rows keeps the earlier version, so you can restore it if you remove too much.