Advanced · Evaluation
Citation precision
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. A metric measuring the proportion of citations in an LLM's response that accurately support the claims made within that response.
Technical Definition
A metric measuring the proportion of citations in an LLM's response that accurately support the claims made within that response.
How it works
Citation precision evaluates the accuracy of the sources an LLM uses in its generated text. It calculates the percentage of citations provided that directly and correctly support the specific facts or claims being made. A high citation precision indicates that when the LLM cites a source, that source is indeed relevant and verifiable for the information presented.
Related Concepts
- Citation recall — A metric assessing what proportion of the source documents an LLM used to generate a response are actually cited within that response.