Advanced · Fundamentals

Tree of Thought (ToT)

Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.

TL;DR. A prompting technique that enables LLMs to explore multiple reasoning paths by maintaining and evaluating intermediate 'thought' steps in a tree structure.

Technical Definition

A prompting technique that enables LLMs to explore multiple reasoning paths by maintaining and evaluating intermediate 'thought' steps in a tree structure.

How it works

Tree of Thought significantly enhances an LLM's problem-solving capabilities by allowing it to explore different logical branches. Instead of a single linear thought process, the model generates multiple potential reasoning paths, evaluates each step, and backtracks if a path proves unproductive. This structured approach leads to more robust and accurate solutions for complex tasks requiring multi-step reasoning.

Related Concepts

• Chain-of-Thought (CoT) Prompting — Asking models to show step-by-step reasoning before giving a final answer, improving accuracy on complex tasks.
• Reasoning engine — A component of a software system that infers conclusions from existing knowledge using logical methods.
• Agentic AI — AI systems designed to independently plan, execute, and adapt actions to achieve a given goal, often involving multiple steps and external tools.