MMLU (Measuring Massive Multitask Language Understanding)

MMLU (Measuring Massive Multitask Language Understanding) is a benchmark designed to evaluate the multitask language understanding abilities of large language models across a wide range of subjects. It measures performance on multiple choice questions derived from professional and academic topics to provide a standardized assessment of general language comprehension and reasoning.

Read More →