HellaSwag
HellaSwag is a benchmark dataset designed to evaluate commonsense reasoning and natural language understanding in artificial intelligence models. It presents multiple-choice questions requiring contextual inference and grounded reasoning.
Commonsense Reasoning
OpenBookQA
OpenBookQA is a benchmark dataset designed for evaluating artificial intelligence systems’ ability to answer elementary science questions using a provided set of facts. It challenges models to perform reasoning beyond simple retrieval by leveraging both a curated ‘open book’ of knowledge and commonsense reasoning.
WinoGrande
WinoGrande is a large-scale dataset designed for evaluating commonsense reasoning in natural language processing. It extends the Winograd Schema Challenge by providing thousands of carefully constructed sentence pairs that test an AI’s ability to resolve ambiguous pronouns.
CommonsenseQA
CommonsenseQA is a benchmark dataset designed to evaluate the ability of artificial intelligence systems to perform commonsense reasoning through multiple-choice questions. It consists of questions that require understanding and applying everyday knowledge beyond factual recall.