AI Safety

Explore AI Safety through related topics and the articles other pages reference most.

Explore articles

Reset filters
Browse subtopics: Model Evaluation

Articles that also belong to these categories. Counts cover all of AI Safety.

Showing 1-16 of 16 articles

Andon Labs

Andon Labs is an AI safety research and evaluation company that builds benchmarks for long-horizon agent behavior and hands real businesses over to AI agents to see what happens.

AI AgentsAI Companies

Cybench

Cybench (short for Cybersecurity benchmark) is an open-source evaluation framework for measuring the cybersecurity capabilities and risks of large language model agents.

AI BenchmarksModel Evaluation

Distribution shift

Distribution shift is the condition in which the probability distribution that produced a model's training data differs from the distribution that produces the data the model actually encounters at test or…

Data & DatasetsMachine Learning

Fangcun AI

Fangcun AI (Chinese: 方寸跃迁; also styled Fangcun Leap) is a Chinese AI safety company that evaluates frontier AI models for risk, sells runtime security tools for AI agents, and takes part in AI safety standards…

AI CompaniesChinese AI

Inspect AI

Inspect AI (usually called simply Inspect) is an open-source Python framework for evaluating large language models and AI agents, created by the UK AI Security Institute (AISI) and now developed jointly by the…

Developer ToolsModel Evaluation

NIST ARIA

NIST ARIA (Assessing Risks and Impacts of AI) is a testing, evaluation, validation, and verification (TEVV) program operated by the United States National Institute of Standards and Technology (NIST) to…

AI Policy & RegulationModel Evaluation

Sabotage evaluations

Sabotage evaluations are a set of tests, introduced by Anthropic in October 2024, that try to measure whether a frontier language model is capable of covertly subverting human oversight, decision-making, and…

AnthropicModel Evaluation

Vending-Bench

Vending-Bench is a family of benchmarks from Andon Labs that measures the long-term coherence of large language model-based AI agents by tasking them with running a simulated vending-machine business.

AI AgentsAI Benchmarks