Intermediate · Fundamentals
Decision boundary
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. The line or surface that separates different classes in a classification problem, defining where a model makes its predictions.
Technical Definition
The line or surface that separates different classes in a classification problem, defining where a model makes its predictions.
How it works
A decision boundary is a hypersurface that partitions the underlying feature space into discrete regions. In classification tasks, instances falling on one side of the boundary are assigned one class, while instances on the other side are assigned another class. The complexity of the decision boundary a model can learn is related to its architecture.
Related Concepts
- Neural Network — A computing system inspired by biological neural networks that learns patterns from data through interconnected layers of nodes.
- Classification — A supervised learning task where the model assigns inputs to discrete categories.
- Perceptron — A simple algorithm for supervised learning of binary classifiers, forming a basic type of artificial neuron.