CRUXEval
CRUXEval (Code Reasoning, Understanding, and eXecution Evaluation) is a benchmark designed to measure how well large language models can reason about, understand, and mentally execute short Python programs.
AI Code Generation
Explore AI Code Generation through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Machine Learning
Articles that also belong to these categories. Counts cover all of AI Code Generation.
All articles (114)Developer Tools (45)AI Agents (34)AI Benchmarks (25)Open Source AI (23)Large Language Models (18)AI Tools & Products (17)AI Companies (15)Software Development (14)AI Models (9)Chinese AI (9)Artificial Intelligence (8)Machine Learning (7)Model Evaluation (6)Google (5)AI Infrastructure (3)Anthropic (3)Meta AI (3)Microsoft (3)Natural Language Processing (3)Google DeepMind (2)Multimodal AI (2)OpenAI (2)AI Research (1)AI Safety (1)ChatGPT (1)China AI (1)Data & Datasets (1)Generative AI (1)Mixture of Experts (1)People (1)Prompt Engineering (1)Training & Optimization (1)
Showing 1-7 of 7 articles
Claude Sonnet 4.5
Claude Sonnet 4.5 is a multimodal large language model (LLM) developed by Anthropic and released on September 29, 2025, which Anthropic described at launch as "the best coding model in the world." It is a…
CodeContests
CodeContests is a competitive programming dataset created by Google DeepMind for training and evaluating machine learning models on algorithmic problem-solving tasks.
LiveCodeBench
LiveCodeBench is a holistic and contamination-free benchmark for evaluating large language models on code, first released in March 2024 by researchers at UC Berkeley, MIT, and Cornell led by Naman Jain.
MBPP
MBPP (Mostly Basic Python Problems) is a code generation benchmark of 974 crowd-sourced Python programming tasks designed to be solvable by entry-level programmers, introduced by Jacob Austin, Augustus Odena…
Pass@k
Pass@k is the standard metric for evaluating code generation models: it measures the probability that at least one of k generated candidate solutions passes all of a problem's unit tests.
Program Synthesis
Program synthesis is the task of automatically constructing a program that satisfies a specification expressed at a higher level than the code itself: a logical formula, a set of input-output examples, a…