Beginner · Neural Networks
Fully connected layer
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. A layer in a neural network where each neuron is connected to every neuron in the preceding layer.
Technical Definition
A layer in a neural network where each neuron is connected to every neuron in the preceding layer.
How it works
A fully connected layer, also known as a dense layer, is a fundamental building block in many neural network architectures. In this type of layer, every single neuron receives input from and sends output to every neuron in the adjacent layers. These layers are essential for learning complex patterns and relationships within data.
Related Concepts
- Deep Learning — A subset of machine learning using neural networks with many layers to learn hierarchical representations from large datasets.
- Hidden Layer — Any layer in a neural network that is neither the input nor the output.
- Dense layer — Another name for a fully connected layer in a neural network.