Beginner · Evaluation

Evaluation

Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.

TL;DR. The process of measuring a model's quality or comparing different models.

Technical Definition

The process of measuring a model's quality or comparing different models.

How it works

Evaluation is the critical step of assessing how well a machine learning model performs, either on its own or in comparison to other models. This typically involves using validation and test datasets to measure accuracy, predictiveness, and other relevant metrics. For LLMs, evaluation extends to assessing broader quality and safety aspects.

Further Reading

• Google ML Glossary