Machine Learning

A/B Testing

See also: Machine learning terms, Data analysis, Statistical hypothesis testing A/B testing (also called split testing, bucket testing, or an online controlled...

Data ScienceStatistics

AI Agents

An AI agent is a software system that selects and performs actions in an environment in pursuit of an objective. In contemporary usage, the term often refers...

AI AgentsArtificial Intelligence

AI Alignment

AI alignment is the study and practice of making artificial intelligence systems behave in ways that accord with intended goals, preferences, constraints, or...

AI EthicsAI Safety

AI Drug Discovery

AI drug discovery refers to the use of artificial intelligence techniques, including machine learning, deep learning, generative models, and natural language...

AI Tools & ProductsArtificial Intelligence

AI for Science

AI for science is the use of artificial intelligence, particularly deep learning and large language models, to accelerate scientific discovery across biology,...

Artificial Intelligence

AQLM (Additive Quantization of Language Models)

AQLM, short for Additive Quantization of Language Models, is a weight-only post-training quantization method that compresses the weights of a large language...

AI Infrastructure

ARC-AGI-2

ARC-AGI-2 (Abstraction and Reasoning Corpus for Artificial General Intelligence 2) is an abstract reasoning benchmark for artificial intelligence, released on...

2025 in artificial intelligenceAI Benchmarks

ARIMA

See also: Time series, Time series analysis, Forecasting, Stationarity, Linear regression ARIMA (Autoregressive Integrated Moving Average) is a class of...

Statistics

AUC (Area Under the ROC Curve)

AUC (Area Under the ROC Curve) is a classifier evaluation metric equal to the probability that a model ranks a randomly chosen positive instance higher than a...

Model Evaluation

AUC-ROC

See also: Machine learning terms AUC (Area Under the Curve), most often the area under the ROC curve (AUC-ROC), is a threshold-independent evaluation metric...

Model EvaluationStatistics

Abacus.AI

Abacus.AI is an American enterprise artificial intelligence and machine learning platform company headquartered in San Francisco, California. The firm was...

AI CompaniesDeveloper Tools

Absolute Zero Reasoner

Absolute Zero Reasoner (AZR) is a research system for post-training a pretrained language model through self-play on machine-generated Python reasoning tasks....

Deep Learning

Accuracy

See also: machine learning terms, confusion matrix, precision, recall, F1 score Accuracy is a classification metric that measures the fraction of predictions a...

Model Evaluation

Action (Reinforcement Learning)

In reinforcement learning (RL), an action is a decision or move made by an agent that affects the state of the environment. At each discrete time step, the...

Reinforcement Learning

Action Chunking with Transformers (ACT)

Action Chunking with Transformers (ACT) is an imitation learning algorithm for fine-grained robotic manipulation that predicts a short sequence (a "chunk") of...

RoboticsTransformer Models

Activation Function

An activation function is a nonlinear mathematical function applied to the output of each neuron in an artificial neural network, and it is what gives the...

Deep LearningNeural Networks

Active Learning

See also: Machine learning terms, Semi-supervised learning, Bayesian optimization Active learning is a subfield of machine learning in which the learning...

Actor-critic methods

Actor-critic methods are a family of reinforcement learning algorithms that learn two things at once: a parameterized policy, called the actor, which chooses...

AlgorithmsDeep Learning

AdaBoost

AdaBoost (short for Adaptive Boosting) is a machine learning ensemble algorithm that combines many weak classifiers into a single strong classifier through a...

AdamW

AdamW is a variant of the Adam optimizer that decouples weight decay from the gradient-based update rule, applying the decay directly to the weights instead of...

Training & Optimization

Agentic Context Engineering

Agentic Context Engineering (ACE) is a framework for scalable and efficient context adaptation in large language models (LLMs) that lets an AI system improve...

AI AgentsArtificial Intelligence

Agglomerative clustering

See also: Machine learning terms Agglomerative clustering is a bottom-up form of hierarchical clustering used in unsupervised learning in which each data point...

AlexNet

AlexNet is a deep learning convolutional neural network, built by Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton at the University of Toronto, that won...

Computer VisionDeep Learning

Algorithmic bias

Algorithmic bias is the tendency of a computer system to produce systematic, repeatable errors that advantage some groups of people over others. The term...

AI EthicsAI Policy & Regulation

Algorithmic fairness

Algorithmic fairness is the study of how automated decision systems can be made to produce decisions that are equitable across protected attributes such as...

AI EthicsAI Safety

AlphaFold

AlphaFold is an artificial intelligence system developed by Google DeepMind that predicts the three-dimensional structure of a protein directly from its amino...

Artificial IntelligenceGoogle

Amazon SageMaker

Amazon SageMaker is Amazon Web Services' fully managed machine learning platform for building, training, and deploying models at scale, first launched at AWS...

AI InfrastructureAI Tools & Products

Andrew Barto

Andrew Barto is an American computer scientist and one of the founders of modern reinforcement learning, the branch of machine learning in which an agent...

PeopleReinforcement Learning

Andrew Ng

Andrew Ng is a British-American computer scientist and entrepreneur who is one of the most influential figures in modern artificial intelligence, best known...

Artificial Intelligence

Anomaly Detection

In machine learning, anomaly detection is the process of identifying data points, events, or observations that deviate significantly from normal patterns in a...

Data Science

Area under the PR curve

See also: Machine learning terms The area under the precision-recall curve (AUPRC), also known as average precision (AP) or PR-AUC, is a scalar summary of a...

Area under the curve

Area under the curve (AUC) is a single scalar metric that summarizes the performance of a binary classifier or diagnostic test across all possible decision...

Model EvaluationStatistics

Artificial Intelligence

Artificial intelligence (AI) is the field of computer science dedicated to creating systems that perform tasks normally requiring human intelligence, such as...

Artificial IntelligenceComputer Science

Attention

Attention is a family of operations in neural networks that computes an output by assigning data-dependent weights to a collection of representations and...

Deep LearningNeural Networks

Attention Is All You Need

"Attention Is All You Need" is the 2017 research paper that introduced the transformer, the neural network architecture that underpins virtually every modern...

Deep LearningNatural Language Processing

Attribute

See also: Machine learning terms In machine learning and data mining, an attribute is an individual measurable property of an object, observation, or example...

Attribute sampling

See also: Machine learning terms Attribute sampling is a randomization technique in which a decision tree considers only a small, randomly drawn subset of the...

Audio Classification Models

See also: Audio Models and Audio Audio classification models are machine learning systems for audio classification, the task of assigning one or more labels to...

Deep LearningSpeech & Audio AI

Automatic Differentiation

Automatic differentiation (abbreviated AD, also called algorithmic differentiation, autodiff, or autograd) is a family of techniques for computing exact...

AI InfrastructureMathematics

Automation Bias

Automation bias is the tendency for humans to favor suggestions and outputs from automated decision-making systems over contradictory information from...

AI Ethics

Autoregressive Model

An autoregressive model predicts each element of a sequence from the elements that precede it, feeding its own earlier outputs back in as context for every...

Large Language Models

Average Precision

See also: precision, recall, F1 score, confusion matrix, AUC, precision-recall curve Average precision (AP) is an evaluation metric that summarizes the...

Computer VisionInformation Retrieval

Axis-aligned condition

See also: Machine learning terms In a decision tree, an axis-aligned condition is a split test at an internal node that involves only a single feature,...

BERTScore

BERTScore is an automatic, reference-based metric for evaluating text generation that scores a candidate sentence against one or more references by comparing...

Model EvaluationNatural Language Processing

BIG-Bench

BIG-Bench (Beyond the Imitation Game Benchmark) is a large-scale, collaborative benchmark of 204 tasks, contributed by 450 authors across 132 institutions,...

AI BenchmarksLarge Language Models

BIG-Bench Hard

BIG-Bench Hard (BBH) is a suite of 23 challenging tasks drawn from the BIG-Bench benchmark, selected because they are "the [tasks] for which prior language...

AI BenchmarksNatural Language Processing

BLEU (Bilingual Evaluation Understudy)

BLEU (Bilingual Evaluation Understudy) is an automatic evaluation metric that scores the quality of machine translation output by measuring how many word...

Model EvaluationNatural Language Processing

Backpropagation

Backpropagation is an algorithm for computing derivatives of a scalar objective with respect to variables in a layered or otherwise composed computation. It...

Deep LearningNeural Networks

Bag of Words

The bag of words (BoW) model is a text representation method that converts a document into a fixed-length numeric vector by counting how often each word from a...

Natural Language Processing

Bagging

See also: Machine learning terms, Ensemble methods, Random forest, Boosting Bagging, short for bootstrap aggregating, is an ensemble learning technique in...

Baseline

See also: Machine learning terms, Model evaluation In machine learning, a baseline is a simple reference model or method used as a point of comparison to judge...

Model Evaluation

Batch

See also: machine learning terms, batch size, gradient descent A batch in machine learning is the set of training examples processed together in one forward...

Deep Learning

Batch Normalization

Batch normalization (BatchNorm or BN) is a normalization method used inside some neural networks. During training, it standardizes each selected activation...

Deep LearningNeural Networks

Batch Size

In machine learning, batch size is the hyperparameter that sets how many training examples a model processes together before it updates its parameters with one...

Deep Learning

Bayes' theorem

Bayes' theorem (also called Bayes' rule or Bayes' law) is a fundamental theorem of probability theory that describes how to update the probability of a...

MathematicsStatistics

Bayesian Neural Network

See also: Machine learning terms A Bayesian neural network (BNN) is a neural network in which the weights and biases are represented as probability...

Deep LearningNeural Networks

Bayesian Optimization

See also: Machine learning terms, Hyperparameter tuning, AutoML Bayesian optimization is a sequential, model-based strategy for finding the global optimum of...

Training & Optimization

Bayesian inference

Bayesian inference is a method of statistical inference in which Bayes' theorem is used to update the probability of a hypothesis as new evidence or data...

Statistics

Bayesian network

A Bayesian network (also called a belief network, Bayes net, directed graphical model, or probabilistic causal network) is a probabilistic graphical model that...

Statistics

Behavioral Cloning

Behavioral cloning is the approach to imitation learning that reduces control to a supervised learning problem. Given a dataset of states or observations...

Embodied AIReinforcement Learning