Home › Glossary › Evaluation › BoolQ

Intermediate · Evaluation

BoolQ

Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.

TL;DR. Abbreviation for Boolean Questions, a dataset for evaluating yes/no question answering capabilities of LLMs.

Technical Definition

Abbreviation for Boolean Questions, a dataset for evaluating yes/no question answering capabilities of LLMs.

How it works

BoolQ is a dataset used to assess a language model's ability to answer questions that have a 'yes' or 'no' answer. It's a specific benchmark for evaluating reading comprehension and logical inference within NLP tasks.

Related Concepts

  • Evaluation — The process of measuring a model's quality or comparing different models.
  • Question Answering (QA) — A system's ability to automatically answer questions posed in natural language.

Further Reading

  • Google ML Glossary