Advanced · Evaluation
Character N-gram F-score (ChrF)
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. A metric for evaluating machine translation by comparing character n-grams between generated and reference text.
Technical Definition
A metric for evaluating machine translation by comparing character n-grams between generated and reference text.
How it works
Character N-gram F-score, or ChrF, is a metric used to evaluate the quality of machine translation outputs. It works by assessing the overlap of character sequences (n-grams) between the model's generated text and a human-written reference translation. Unlike word-based metrics, it considers sub-word units, making it robust to variations in word segmentation.
Related Concepts
- Machine Translation — The automatic translation of text or speech from one natural language to another using AI.