ARC Evals
ARC Evals was the evaluations team incubated inside the Alignment Research Center (ARC) between 2022 and 2023, and the direct predecessor of METR (Model Evaluation and Threat Research).
Model Evaluation
Explore Model Evaluation through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: AI Safety
Articles that also belong to these categories. Counts cover all of Model Evaluation.
All articles (134)AI Benchmarks (56)Machine Learning (55)Statistics (15)AI Companies (14)Large Language Models (12)AI Safety (11)Natural Language Processing (9)AI Agents (6)AI Code Generation (6)Developer Tools (6)MLOps (5)AI Ethics (4)Deep Learning (4)Open Source AI (4)Reasoning Models (4)AI Policy & Regulation (3)Computer Vision (3)Data & Datasets (3)AI Infrastructure (2)AI Research (2)AI Tools & Products (2)Information Retrieval (2)Meta AI (2)Reinforcement Learning (2)Training & Optimization (2)2025 in artificial intelligence (1)AI Models (1)Anthropic (1)Artificial Intelligence (1)Data Centers (1)Education AI (1)Finance AI (1)Google DeepMind (1)Interpretability (1)NVIDIA (1)Neural Networks (1)Research Organizations (1)Software Development (1)Speech & Audio AI (1)Video Generation (1)World Models (1)
Showing 1-11 of 11 articles
Cybench
Cybench (short for Cybersecurity benchmark) is an open-source evaluation framework for measuring the cybersecurity capabilities and risks of large language model agents.
Distribution shift
Distribution shift is the condition in which the probability distribution that produced a model's training data differs from the distribution that produces the data the model actually encounters at test or…
NIST ARIA
NIST ARIA (Assessing Risks and Impacts of AI) is a testing, evaluation, validation, and verification (TEVV) program operated by the United States National Institute of Standards and Technology (NIST) to…
Patronus AI
Patronus AI is an automated LLM evaluation, observability, and guardrails platform founded in 2023 and headquartered in San Francisco.
Process reward model (PRM)
A process reward model (PRM), also called a process-supervised reward model or step-level verifier, is a learned scoring model that evaluates the correctness or quality of each intermediate step in a large…
Sabotage evaluations
Sabotage evaluations are a set of tests, introduced by Anthropic in October 2024, that try to measure whether a frontier language model is capable of covertly subverting human oversight, decision-making, and…
Sandbagging (artificial intelligence)
Sandbagging, in the context of AI safety, refers to the strategic and intentional underperformance of an AI system on a capability evaluation or specific task, typically to hide a capability from human…
StrongREJECT
StrongREJECT is a benchmark and automated evaluator for measuring how well jailbreaking attacks actually work against large language models.
Task-completion time horizon (METR)
The task-completion time horizon is a metric for AI capability proposed by METR that expresses a model's ability in units of human time: it is the length of task
UK AI Security Institute
The UK AI Security Institute (AISI) is a research organization within the United Kingdom's Department for Science, Innovation and Technology (DSIT) that conducts pre-deployment evaluations of frontier AI…