Benchmarks are important tools for tracking the rapid advancements in large language model (LLM) capabilities. However, benchmarks are not keeping pace indifficulty: LLMs now achieve over 90% accuracy on popular benchmarks likeMMLU, limiting informed measurement of state-of-the-art LLM capabilities. Inresponse, we introduce HUMANITY’S LAST EXAM (HLE), a multi-modal benchmark at the frontier of human knowledge, designed to be the final closed-endedacademic benchmark of its kind with broad subject coverage. HLE consists of2,500 questions across dozens of subjects, including mathematics, humanities, andthe natural sciences. HLE is developed globally by subject-matter experts and consists of multiple-choice and short-answer questions suitable for automated grading.Each question has a known solution that is unambiguous and easily verifiable, butcannot be quickly answered via internet retrieval. State-of-the-art LLMs demonstrate low accuracy and calibration on HLE, highlighting a significant gap betweencurrent LLM capabilities and the expert human frontier on closed-ended academicquestions. To inform research and policymaking upon a clear understanding ofmodel capabilities, we publicly release HLE at https://lastexam.ai.