Intermediate · Data
Incremental learning
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. A machine learning approach where a model continuously learns from new data without forgetting previous knowledge.
Technical Definition
A machine learning approach where a model continuously learns from new data without forgetting previous knowledge.
How it works
Incremental learning, also known as online learning, allows a machine learning model to be updated with new data over time. This is particularly useful when dealing with large datasets that cannot fit into memory or when data arrives sequentially. The model adapts and extends its knowledge without needing to be retrained from scratch on the entire dataset.
Related Concepts
- Supervised Learning — Learning from input–output pairs where each training example carries a correct label.
- Unsupervised Learning — Learning patterns from data that has no labels — only the inputs.