Showing 61-99 of 99 articles
Pass@k
Pass@k is the standard metric for evaluating code generation models: it measures the probability that at least one of k generated candidate solutions passes...
AI BenchmarksMachine Learning
Poolside AI
Poolside AI is an American-founded artificial intelligence company that trains its own foundation models for software development and sells them to enterprises...
AI Companies
Programming with ChatGPT
Programming with ChatGPT is the practice of using OpenAI's conversational chatbot to read, write, refactor, document, debug, test, and explain source code in...
ChatGPTOpenAI
Qodo
Qodo (formerly CodiumAI or Codium) is an AI-powered code integrity platform that provides automated code review, test generation, and code quality tools for...
AI Tools & ProductsDeveloper Tools
Qwen2.5-Coder
Qwen2.5-Coder is the code-specialized series within the Qwen2.5 generation of large language models developed by the Qwen team at Alibaba. It is the successor...
Chinese AILarge Language Models
Qwen3-Coder-Next
Qwen3-Coder-Next is an open-weight code generation model released by Alibaba's Qwen team on February 3, 2026, under the Apache 2.0 license. It is an...
Chinese AIOpen Source AI
Replit
Replit is an online integrated development environment (IDE) and AI-powered coding platform that lets users write, run, and deploy software directly from a web...
AI InfrastructureDeveloper Tools
RepoBench
RepoBench is an AI benchmark for repository-level code auto-completion, introduced in the 2023 paper "RepoBench: Benchmarking Repository-Level Code...
AI Benchmarks
Roo Code
Roo Code is an open-source AI coding agent that runs as a Visual Studio Code extension. It gives developers an autonomous assistant capable of reading and...
AI AgentsDeveloper Tools
SWE-Atlas
SWE-Atlas is a benchmark for evaluating AI coding agents on professional software-engineering work that goes beyond fixing bugs and resolving issues. Built by...
AI AgentsAI Benchmarks
SWE-Bench Pro
SWE-Bench Pro (stylized SWE-BENCH PRO) is a contamination-resistant benchmark, released by Scale AI in September 2025, that measures whether an AI coding agent...
AI AgentsAI Benchmarks
SWE-Lancer
SWE-Lancer is a benchmark released by OpenAI in February 2025 that evaluates the ability of frontier large language models to perform real-world freelance...
AI BenchmarksOpenAI
SWE-agent
SWE-agent is an open-source autonomous software engineering agent created by the Princeton NLP group (Princeton Language and Intelligence, with co-authors from...
AI AgentsOpen Source AI
SWE-bench Multilingual
SWE-bench Multilingual is an AI benchmark of 300 real-world software bug-fixing tasks drawn from 42 open-source repositories across nine programming languages,...
AI Benchmarks
SWE-bench Multimodal
SWE-bench Multimodal (also written SWE-bench M) is a benchmark that measures whether autonomous software-engineering systems can resolve bugs in visual,...
AI BenchmarksMultimodal AI
SWE-bench Verified
Software Engineering Benchmark, Verified subset Abbreviation A 500-task, human-validated subset of SWE-bench for evaluating AI agents on real-world GitHub...
AI BenchmarksModel Evaluation
SWE-rebench
SWE-rebench is a continuously refreshed, contamination-resistant AI benchmark and public leaderboard for evaluating AI agents on real-world software...
AI Benchmarks
SantaCoder
SantaCoder is a 1.1 billion parameter large language model for code generation, released in early 2023 by the BigCode project, an open scientific collaboration...
Large Language Models
Scott Wu
Scott Wu is an American entrepreneur and competitive programmer who is the co-founder and chief executive officer of Cognition AI, the startup behind Devin, an...
People
Sourcegraph Cody
Sourcegraph Cody is an enterprise AI coding assistant built by Sourcegraph that combines large language models with the company's code-search and code-graph...
AI Tools & ProductsDeveloper Tools
Spec-driven development
Spec-driven development (SDD) is a software engineering methodology in which structured specification documents serve as the primary source of truth for a...
AI AgentsSoftware Development
Spider 2.0
Spider 2.0 is a benchmark for evaluating large language models on real-world enterprise text-to-SQL workflows. Introduced by Fangyu Lei and colleagues in the...
AI BenchmarksModel Evaluation
StarCoder
StarCoder is a family of open-access large language models for code generation and code understanding, developed by the BigCode project, an open scientific...
Large Language ModelsOpen Source AI
Supermaven
Supermaven was an AI code completion tool that used a proprietary neural network architecture to deliver fast, context-aware code suggestions directly inside a...
AI Tools & ProductsDeveloper Tools
Sweep (software)
Sweep (stylized with a broom emoji and reachable at sweep.dev) is an AI developer tool built by the San Francisco startup of the same name, founded in 2023 by...
AI AgentsDeveloper Tools
Tabby (software)
Tabby is an open-source, self-hosted AI code generation assistant developed by TabbyML, Inc.[1] It is positioned as a privacy-preserving, on-premises...
Developer ToolsOpen Source AI
Tabnine
Tabnine is a privacy-focused, enterprise artificial intelligence code assistant that provides inline code completions, chat-based assistance, test generation,...
Artificial IntelligenceDeveloper Tools
Terminal-Bench
Terminal-Bench is an open benchmark for evaluating AI agents on complex, real-world tasks performed through command-line terminal interfaces. Developed as a...
AI AgentsAI Benchmarks
The Stack (BigCode dataset)
The Stack is a family of large, permissively-licensed source-code datasets built by the BigCode project, an open scientific collaboration jointly led by...
Data & DatasetsOpen Source AI
TheAgentCompany
TheAgentCompany is an AI benchmark that evaluates AI agents on long-horizon, economically valuable knowledge work inside a self-hosted simulation of a small...
AI Benchmarks
Trae
Trae (styled TRAE, short for The Real AI Engineer) is an AI-native integrated development environment (IDE) developed by ByteDance, the Chinese technology...
Chinese AIDeveloper Tools
Vibe Code Bench
Vibe Code Bench (VCB) is a benchmark that measures whether AI models can build a complete, deployable web application from nothing but a written specification....
AI Benchmarks
Vibe Coding Tips and Tricks
See also: Vibe Coding Vibe coding is the practice of building software by describing what you want in natural language and letting an AI write the code. The...
Prompt EngineeringSoftware Development
Vibe coding
Vibe coding is a software development practice in which a programmer describes their intent in plain natural language and relies on a large language model...
Artificial IntelligenceSoftware Development
Vibe engineering
Vibe engineering is a term for the disciplined practice of building production software with the help of large language model coding agents, in contrast to the...
Software Development
Web Development
See also: Web Development ChatGPT Plugins AI in web development is the use of large language models and related generative systems to design, build, deploy,...
Software Development
Windsurf (software)
Windsurf is an AI-powered code editor developed by the company formerly known as Codeium (originally Exafunction). Launched in November 2024, Windsurf...
Artificial IntelligenceDeveloper Tools
opencode (SST)
opencode is an open-source AI coding agent built for the terminal. Developed by Anomaly Innovations, formerly known as the SST (Serverless Stack) team, it...
AI AgentsDeveloper Tools
v0 (Vercel)
v0 is an AI application builder from Vercel that turns natural-language prompts and images into working React code, generating user interfaces styled with...
Developer ToolsSoftware Development