Advanced · Evaluation
BLEURT (Bilingual Evaluation Understudy from Transformers)
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. A metric that uses pre-trained language models to evaluate machine translation quality, focusing on semantic similarity.
Technical Definition
A metric that uses pre-trained language models to evaluate machine translation quality, focusing on semantic similarity.
How it works
BLEURT is an advanced metric for evaluating machine translations that leverages pre-trained transformer models. It's designed to better capture semantic meaning and handle paraphrasing compared to traditional methods like BLEU, aligning more closely with human judgments.
Related Concepts
- Machine Translation — The automatic translation of text or speech from one natural language to another using AI.
- Evaluation Metrics — Quantitative measures used to assess the performance, accuracy, and quality of AI models for specific tasks.