Beginner · Evaluation

Confidence Score

Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.

TL;DR. A numerical value indicating the AI's certainty in its prediction, such as an intent classification.

Technical Definition

A numerical value indicating the AI's certainty in its prediction, such as an intent classification.

How it works

A Confidence Score helps in decision-making for the AI system. If the confidence in an intent recognition is low, the AI might ask for clarification or escalate to a human. This allows the system to manage uncertainty intelligently, preventing misinterpretations and improving overall robustness.

Related Concepts

• Intent Recognition — Identifying the underlying purpose or goal of a user's natural language input.
• Fall-back Strategies — Pre-defined actions an AI takes when it cannot understand a user's query or fulfill a request.
• Threshold (AI) — A predefined level that an AI model's confidence score must meet to trigger a specific action.