Advanced · Research

Continual Learning

Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.

TL;DR. Training models that keep learning new tasks over time without forgetting old ones.

Technical Definition

Training models that keep learning new tasks over time without forgetting old ones.

How it works

The central challenge is catastrophic forgetting: standard training overwrites previously learned knowledge. Solutions include rehearsal buffers, elastic weight consolidation, and modular architectures. Critical for agents and personal assistants that operate over long horizons.

Related Concepts

• Transfer Learning — Leveraging knowledge from a model trained on one task to improve performance on a different but related task.
• Training — The process of adjusting a model's parameters so it learns patterns from labeled or unlabeled data.