AI Benchmarks

Explore AI Benchmarks through related topics and the articles other pages reference most.

239 articlesSearch and filter Follow updates by RSS

Explore articles

Browse subtopics: Large Language Models

Articles that also belong to these categories. Counts cover all of AI Benchmarks.

All articles (239)Model Evaluation (56)Natural Language Processing (42)Large Language Models (33)AI Agents (28)AI Code Generation (25)AI Safety (25)Machine Learning (22)Computer Vision (19)Multimodal AI (15)Reasoning Models (13)Data & Datasets (11)Artificial Intelligence (8)OpenAI (6)AI Research (5)Healthcare AI (4)Mathematics (4)Open Source AI (4)AI Companies (3)AI Ethics (3)AI Hardware (3)Developer Tools (3)Google DeepMind (3)Image Generation (3)Information Retrieval (3)NVIDIA (3)Robotics (3)Reinforcement Learning (2)Software Development (2)Speech & Audio AI (2)Statistics (2)World Models (2)2025 in artificial intelligence (1)AI Alignment (1)AI Inference (1)AI Models (1)AI in Cybersecurity (1)Autonomous Vehicles (1)Data Science (1)Deep Learning (1)Education AI (1)Embodied AI (1)Enterprise AI (1)Finance AI (1)Generative AI (1)Legal AI (1)Meta AI (1)Microsoft (1)People (1)Physical AI (1)Research Organizations (1)Video Generation (1)

Showing 1-33 of 33 articles

AdvBench

AdvBench (Adversarial Behavior Benchmark) is a red-teaming benchmark dataset for measuring how easily an aligned large language model can be pushed into producing harmful or objectionable content

AI Safety Large Language Models

AgentBench

AgentBench is a multi-dimensional benchmark for evaluating large language models (LLMs) as autonomous agents across eight distinct interactive environments

AI Agents Large Language Models

AlpacaEval

AlpacaEval is an automatic evaluation framework for instruction-following large language models (LLMs) developed by Stanford University's Tatsu Lab

Large Language Models Natural Language Processing

Artificial Analysis is an independent benchmarking and analytics platform that evaluates artificial intelligence models and API providers across intelligence, speed, price, and latency, and it is best known…

Developer Tools Large Language Models

BABILong

BABILong is a benchmark for testing how well a large language model can reason over facts scattered through very long text.

Large Language Models Model Evaluation

BIG-Bench

BIG-Bench (Beyond the Imitation Game Benchmark) is a large-scale, collaborative benchmark of 204 tasks, contributed by 450 authors across 132 institutions, built to measure and extrapolate the capabilities of…

Large Language Models Machine Learning

Berkeley Function Calling Leaderboard

The Berkeley Function Calling Leaderboard (BFCL) is the standard benchmark for measuring how accurately large language models (LLMs) invoke functions, APIs, and tools, created by the Gorilla project at UC…

Large Language Models

Chatbot Arena

Chatbot Arena (now branded simply as Arena, and previously known as LMArena) is a crowdsourced evaluation platform for large language models that ranks AI systems based on human preferences through anonymous…

Large Language Models

FACTS Grounding

FACTS Grounding is a factuality benchmark from Google DeepMind and Google Research that measures whether a large language model answers a request using only the information in a provided source document

Large Language Models Model Evaluation

GSM8K

GSM8K (Grade School Math 8K) is an English-language benchmark of grade-school arithmetic word problems released by OpenAI researchers in 2021.

Large Language Models Machine Learning

HaluEval

HaluEval (Hallucination Evaluation) is a large-scale benchmark for measuring how well large language models (LLMs) can recognize hallucinated content, that is, text that conflicts with a source or cannot be…

AI Safety Large Language Models

HarmBench

HarmBench is a standardized evaluation framework for automated red teaming and robust refusal of large language models (LLMs).

AI Safety Large Language Models

IFEval

IFEval (Instruction-Following Evaluation) is a benchmark of 541 prompts that measures how reliably large language models obey explicit, machine-checkable instructions such as "write in more than 400 words,"…

Large Language Models Natural Language Processing

InfiniteBench

InfiniteBench (stylized as ∞Bench) is a long-context benchmark that tests whether large language models (LLMs) can genuinely process and reason over inputs longer than 100,000 tokens, using 12 tasks that span…

Large Language Models Natural Language Processing

JailbreakBench

JailbreakBench is an open-source robustness benchmark for evaluating jailbreak attacks and defenses against large language models (LLMs).

AI Safety Large Language Models

LLM Benchmark Comparison (Leaderboard Overview)

As of July 2026, no single model wins every LLM benchmark, but Anthropic's Claude Fable 5 tops the most: it currently leads MMLU-Pro (91.5%), SWE-bench Verified (95.0%), Humanity's Last Exam in both the…

Large Language Models Model Evaluation

LLM Evaluation

LLM evaluation is the practice of measuring what a large language model can do, how reliably it does it, and how it behaves under adversarial or high-stakes conditions.

AI Research Large Language Models

LLM-as-a-judge

LLM-as-a-judge is the practice of using a strong large language model to evaluate the outputs of other models, or of itself, in place of a human annotator.

Large Language Models Model Evaluation

LegalBench

LegalBench is a collaboratively constructed benchmark for measuring legal reasoning in large language models (LLMs)

Large Language Models Legal AI

LongBench

LongBench is a benchmark suite for evaluating the long-context understanding capabilities of large language models (LLMs).

Large Language Models Natural Language Processing

LongBench v2

LongBench v2 is a benchmark for evaluating how well large language models understand and reason over long contexts.

Large Language Models Model Evaluation

MBPP

MBPP (Mostly Basic Python Problems) is a code generation benchmark of 974 crowd-sourced Python programming tasks designed to be solvable by entry-level programmers, introduced by Jacob Austin, Augustus Odena…

AI Code Generation Large Language Models

MMLU-Pro

MMLU-Pro (Massive Multitask Language Understanding Professional) is an artificial intelligence benchmark of 12,032 ten-choice questions across 14 academic domains

Large Language Models Machine Learning

MMLU-ProX

MMLU-ProX is a multilingual benchmark for evaluating reasoning and knowledge in large language models

Large Language Models

MMMU-Pro

MMMU-Pro is a rigorous benchmark for evaluating multimodal AI systems on college-level, expert questions that genuinely require seeing an image, built as a harder and more robust version of the original MMMU…

Computer Vision Large Language Models

MRCR

MRCR (Multi-Round Co-reference Resolution) is a synthetic long-context evaluation that tests whether a large language model can locate and disambiguate among several near-identical "needles" buried inside a…

Large Language Models Model Evaluation

MT-Bench

MT-Bench (Multi-Turn Benchmark) is a benchmark of 80 hand-written, two-turn questions that evaluates large language models (LLMs) on multi-turn conversation and instruction following by using a strong model…

Large Language Models Natural Language Processing

Needle in a Haystack (NIAH)

Needle in a Haystack (NIAH) is a long-context evaluation that measures whether a large language model can retrieve a single fact (the "needle") inserted at a controlled position inside a long body of text (the…

Large Language Models

NoLiMa

NoLiMa, short for "No Literal Matching," is a long-context benchmark for large language models that measures how well a model can find and use a single relevant fact buried in a long document when that fact…

Large Language Models Model Evaluation

RULER (benchmark)

RULER is a synthetic benchmark from NVIDIA that measures the real, usable context window of large language models (LLMs) by testing them on 13 tasks across four categories (retrieval, multi-hop tracing…

Large Language Models

Tokens per second

Tokens per second (TPS) is a key performance metric for measuring the speed of large language model (LLM) inference. It quantifies how many tokens a model can generate or process in one second.

AI Hardware Large Language Models

WritingBench

WritingBench is a comprehensive benchmark for evaluating the generative writing capabilities of large language models (LLMs) across diverse real-world writing tasks.

Large Language Models Natural Language Processing

ZebraLogic

ZebraLogic is a benchmark for evaluating the logical reasoning capabilities of large language models (LLMs).

Large Language Models Natural Language Processing