Home › Glossary › Fundamentals › Bias (math) or bias term

Beginner · Fundamentals

Bias (math) or bias term

Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.

TL;DR. A parameter in machine learning models, often representing an intercept, that shifts the output prediction.

Technical Definition

A parameter in machine learning models, often representing an intercept, that shifts the output prediction.

How it works

The bias term, often denoted as 'b' or 'w0', is an intercept parameter in linear models. It allows the model's output to be offset from the origin, providing a baseline prediction even when all input features are zero. For instance, in a simple linear equation y = mx + b, 'b' is the bias term.

Related Concepts

  • Parameters — The internal variables — weights and biases — that a model learns from data.

Further Reading

  • Google ML Glossary