Beginner · Neural Networks
Full softmax
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. A synonym for the standard softmax function used in multi-class classification.
Technical Definition
A synonym for the standard softmax function used in multi-class classification.
How it works
The term 'full softmax' is used to refer to the standard softmax activation function, particularly in contrast to methods like candidate sampling. Softmax is commonly applied in the output layer of neural networks for multi-class classification problems, converting raw scores into probability distributions over the possible classes.
Related Concepts
- Neural Network — A computing system inspired by biological neural networks that learns patterns from data through interconnected layers of nodes.
- Softmax Function — A function that converts a vector of raw scores into a probability distribution where all values sum to one.
- Candidate sampling — A training optimization technique that reduces computational cost by only calculating probabilities for positive labels and a random sample of negative labels.