Model Evaluation

Explore Model Evaluation through related topics and the articles other pages reference most.

Explore articles

Reset filters
Browse subtopics: AI Safety

Articles that also belong to these categories. Counts cover all of Model Evaluation.

Showing 1-15 of 15 articles

ARC Evals

ARC Evals was the evaluations team incubated inside the Alignment Research Center (ARC) between 2022 and 2023, and the direct predecessor of METR (Model Evaluation and Threat Research).

AI SafetyResearch Organizations

Andon Labs

Andon Labs is an AI safety research and evaluation company that builds benchmarks for long-horizon agent behavior and hands real businesses over to AI agents to see what happens.

AI AgentsAI Companies

Cybench

Cybench (short for Cybersecurity benchmark) is an open-source evaluation framework for measuring the cybersecurity capabilities and risks of large language model agents.

AI BenchmarksAI Safety

Distribution shift

Distribution shift is the condition in which the probability distribution that produced a model's training data differs from the distribution that produces the data the model actually encounters at test or…

AI SafetyData & Datasets

Fangcun AI

Fangcun AI (Chinese: 方寸跃迁; also styled Fangcun Leap) is a Chinese AI safety company that evaluates frontier AI models for risk, sells runtime security tools for AI agents, and takes part in AI safety standards…

AI CompaniesAI Safety

NIST ARIA

NIST ARIA (Assessing Risks and Impacts of AI) is a testing, evaluation, validation, and verification (TEVV) program operated by the United States National Institute of Standards and Technology (NIST) to…

AI Policy & RegulationAI Safety

Patronus AI

Patronus AI is an automated LLM evaluation, observability, and guardrails platform founded in 2023 and headquartered in San Francisco.

AI CompaniesAI Safety

Process reward model (PRM)

A process reward model (PRM), also called a process-supervised reward model or step-level verifier, is a learned scoring model that evaluates the correctness or quality of each intermediate step in a large…

AI SafetyMachine Learning

Sabotage evaluations

Sabotage evaluations are a set of tests, introduced by Anthropic in October 2024, that try to measure whether a frontier language model is capable of covertly subverting human oversight, decision-making, and…

AI SafetyAnthropic

Sandbagging (artificial intelligence)

Sandbagging, in the context of AI safety, refers to the strategic and intentional underperformance of an AI system on a capability evaluation or specific task, typically to hide a capability from human…

AI Safety

StrongREJECT

StrongREJECT is a benchmark and automated evaluator for measuring how well jailbreaking attacks actually work against large language models.

AI BenchmarksAI Safety

Vending-Bench

Vending-Bench is a family of benchmarks from Andon Labs that measures the long-term coherence of large language model-based AI agents by tasking them with running a simulated vending-machine business.

AI AgentsAI Benchmarks