Advanced · Safety
Existential risk from artificial general intelligence
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. The potential risk that advanced artificial general intelligence (AGI) could lead to human extinction or catastrophe.
Technical Definition
The potential risk that advanced artificial general intelligence (AGI) could lead to human extinction or catastrophe.
How it works
Existential risk from AGI refers to the hypothesis that the development of artificial general intelligence could pose a threat to human survival. This could happen if a superintelligent AGI's goals are misaligned with human values, leading to unintended but catastrophic consequences. This area of research focuses on understanding and mitigating such terminal risks.
Related Concepts
- AI Safety & Alignment — The field ensuring AI systems behave as intended, remain under human control, and avoid unintended harm.
- Artificial general intelligence (AGI) — AI that can perform any intellectual task that a human being can.