BridgeBench
BridgeBench is a website that publishes ratings and tests of large language models used for software development, describing itself as "independent benchmarks for AI coding models." It is built and operated by…
Explore Model Evaluation through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of Model Evaluation.
Showing 1-11 of 11 articles
BridgeBench is a website that publishes ratings and tests of large language models used for software development, describing itself as "independent benchmarks for AI coding models." It is built and operated by…
CursorBench is an agentic coding benchmark built and run by Cursor, the AI code editor made by Anysphere.
DeepSWE is a benchmark for AI coding agents made by Datacurve, a San Francisco data company.
FrontierCode is an agentic coding benchmark created by Cognition, the company behind the Devin coding agent.
Multi-SWE-bench is a multilingual benchmark for evaluating the ability of large language model based coding systems to resolve real-world software issues across seven programming languages.
Pass@k is the standard metric for evaluating code generation models: it measures the probability that at least one of k generated candidate solutions passes all of a problem's unit tests.
Real-SWE is a coding-agent benchmark published in September 2026 by Specific Labs, a San Francisco company that licenses operational data and source code from businesses and packages them as training and…
SWE-bench Verified is a 500-problem, human-validated subset of the SWE-bench software engineering benchmark, released on August 13
Spider 2.0 is a benchmark for evaluating large language models on real-world enterprise text-to-SQL workflows.
Terminal-Bench is an open benchmark for evaluating AI agents on complex, real-world tasks performed through command-line terminal interfaces.
VulcanBench is an open-source benchmark for AI coding agents, created and run by Morgan Linton, co-founder and CTO of the apparel-sizing AI company Bold Metrics.