AA-Briefcase
AA-Briefcase is a private benchmark from Artificial Analysis that tests AI agents on long-horizon office work.
Explore Model Evaluation through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of Model Evaluation.
Showing 1-19 of 19 articles
AA-Briefcase is a private benchmark from Artificial Analysis that tests AI agents on long-horizon office work.
AI agent sandbox escapes are incidents in which an AI agent being trained, evaluated, or tested reaches systems outside the isolated environment ("sandbox") meant to contain it, usually the public internet…
Agent Arena is a public leaderboard run by Arena (the evaluation company formerly called LMArena
Agent evaluation is the systematic measurement of how well AI agents (LLM-based systems that plan and act over multiple steps using tools) perform on real-world tasks, using benchmarks, metrics, and testing…
Andon Labs is an AI safety research and evaluation company that builds benchmarks for long-horizon agent behavior and hands real businesses over to AI agents to see what happens.
AutomationBench is a benchmark for AI agents, built by the automation company Zapier, that tests whether a model can finish a multi-step business workflow across several simulated software applications.
BlenderWorld is a benchmark for visual AI agents that build editable 3D scenes in Blender, the open-source 3D creation suite, from text briefs, reference images, reference videos and structured specification…
Build-A-Chip-Bench is a benchmark for AI agents that tests whether an agent can carry a digital chip design from a workload specification all the way to a routed, verified GDS layout
Crusader Bench is an AI benchmark that tests AI agents by having them develop a settlement's economy in Stronghold Crusader: Definitive Edition.
CursorBench is an agentic coding benchmark built and run by Cursor, the AI code editor made by Anysphere.
DeepSWE is a benchmark for AI coding agents made by Datacurve, a San Francisco data company.
FrontierCode is an agentic coding benchmark created by Cognition, the company behind the Devin coding agent.
GDPx is an AI benchmark published by SemiAnalysis on November 2, 2026 to evaluate agents working in simulated professional environments.
Harness, in artificial intelligence, is the software scaffolding that wraps a machine learning model, most often a large language model
SkillEvaluator is an open-source command-line framework developed by NVIDIA for evaluating artifacts used by AI agents.
Terminal-Bench is an open benchmark for evaluating AI agents on complex, real-world tasks performed through command-line terminal interfaces.
Vending-Bench is a family of benchmarks from Andon Labs that measures the long-term coherence of large language model-based AI agents by tasking them with running a simulated vending-machine business.
WebArena is a realistic, self-hosted web environment and benchmark designed for developing and evaluating autonomous AI agents that perform tasks on the web.
WebVoyager is an end-to-end web agent and its companion benchmark, introduced by Hongliang He and seven coauthors in a paper accepted to ACL 2024.