Intermediate · Generative AI
Reinforcement learning from human feedback (RLHF)
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. Training AI using human feedback to guide model behavior and improve output quality.
Technical Definition
Training AI using human feedback to guide model behavior and improve output quality.
How it works
RLHF trains a reward model based on human preferences for AI-generated content. This reward model then guides a generative AI model using reinforcement learning to produce outputs that align with human values, like truthfulness or safety. It helps fine-tune models to be more helpful and harmless.
Related Concepts
- Reinforcement Learning — A paradigm where an agent learns to make decisions by receiving rewards or penalties from its environment through trial and error.
- Human-in-the-loop — System designs where humans review, correct, or guide AI outputs as part of the workflow.
- Generative AI — An AI field focused on creating models that can generate novel and complex content, such as text, images, audio, and video, that is coherent and original.