Intermediate · Evaluation
Boolean Questions (BoolQ)
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. A dataset used to evaluate an LLM's ability to answer yes/no questions based on a given text passage.
Technical Definition
A dataset used to evaluate an LLM's ability to answer yes/no questions based on a given text passage.
How it works
Boolean Questions (BoolQ) is a benchmark dataset designed to test a language model's reading comprehension skills. It presents a question and a passage, requiring the model to determine whether the answer is 'yes' or 'no' based solely on the provided text.
Related Concepts
- Question Answering (QA) — A system's ability to automatically answer questions posed in natural language.