Intermediate · Research
Ablation Study
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. An experiment that removes one component of a system at a time to measure its individual contribution.
Technical Definition
An experiment that removes one component of a system at a time to measure its individual contribution.
How it works
'We added X, Y, and Z and the score went up' is not enough — an ablation removes each in turn to show which actually matter. Standard practice in ML papers and a powerful debugging tool for production systems.
Related Concepts
- Experiment Tracking — Systematically recording the inputs, code, parameters, and outputs of every ML experiment.
- Benchmark — A standardized dataset and evaluation protocol used to compare models.
- Reproducibility — The ability for others to re-run an experiment and obtain the same results.