Beginner · Fundamentals
I.i.d.
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. Independently and identically distributed; a common assumption in machine learning that data points are unrelated and follow the same distribution.
Technical Definition
Independently and identically distributed; a common assumption in machine learning that data points are unrelated and follow the same distribution.
How it works
I.I.D. stands for 'independently and identically distributed'. This is a fundamental assumption in many machine learning algorithms, meaning that each data point in the training set is drawn from the same underlying probability distribution and is independent of all other data points. Violations of this assumption, like temporal dependencies, can significantly impact model performance.
Related Concepts
- Machine Learning — A field of AI where systems learn patterns from data instead of following hard-coded rules.