Category

Natural Language Processing

226 articlesRSS

Showing 1-60 of 226 articles

AA-LCR

Artificial Analysis Long Context Reasoning Abbreviation A benchmark evaluating long context reasoning across multiple real-world documents (approximately...

AI Benchmarks

AI Summary Generators

See also: AI Summary Generators ChatGPT Plugins AI summary generators are software tools that use natural language processing and, increasingly, large language...

AI Tools & Products

AI search

AI search (also called AI-powered search, generative search, or an answer engine) is a class of search engine and search feature that uses large language...

Artificial IntelligenceInformation Retrieval

AI21 Labs

AI21 Labs is an Israeli artificial intelligence company, founded in 2017 by Yoav Shoham, Ori Goshen, and Amnon Shashua, that develops large language models...

AI CompaniesLarge Language Models

ALBERT

ALBERT (A Lite BERT) is a parameter-efficient variant of the BERT language model developed by researchers at Google Research and the Toyota Technological...

Deep LearningTransformer Models

Agent memory

Agent memory is the set of systems that let an AI agent retain and recall information beyond a single context window, so it can carry knowledge, preferences,...

AI AgentsInformation Retrieval

Agentic Context Engineering

Agentic Context Engineering (ACE) is a framework for scalable and efficient context adaptation in large language models (LLMs) that lets an AI system improve...

AI AgentsArtificial Intelligence

Agentic RAG

Agentic RAG (agentic retrieval-augmented generation) is a retrieval-augmented generation design pattern in which one or more autonomous large language model AI...

AI AgentsInformation Retrieval

AlpacaEval

AlpacaEval is an automatic evaluation framework for instruction-following large language models (LLMs) developed by Stanford University's Tatsu Lab, which...

AI BenchmarksLarge Language Models

Attention Is All You Need

"Attention Is All You Need" is the 2017 research paper that introduced the transformer, the neural network architecture that underpins virtually every modern...

Deep LearningMachine Learning

BART (language model)

BART (an acronym for Bidirectional and Auto-Regressive Transformers) is a transformer-based encoder-decoder language model introduced by Mike Lewis, Yinhan...

AI ModelsMeta AI

BBQ (Bias Benchmark for QA)

BBQ (the Bias Benchmark for QA) is a hand-built evaluation dataset that measures whether a question answering (QA) language model relies on social stereotypes...

AI BenchmarksAI Ethics

BERTScore

BERTScore is an automatic, reference-based metric for evaluating text generation that scores a candidate sentence against one or more references by comparing...

Machine LearningModel Evaluation

BIG-Bench Hard

BIG-Bench Hard (BBH) is a suite of 23 challenging tasks drawn from the BIG-Bench benchmark, selected because they are "the [tasks] for which prior language...

AI BenchmarksMachine Learning

BLEU (Bilingual Evaluation Understudy)

BLEU (Bilingual Evaluation Understudy) is an automatic evaluation metric that scores the quality of machine translation output by measuring how many word...

Machine LearningModel Evaluation

Bag of Words

The bag of words (BoW) model is a text representation method that converts a document into a fixed-length numeric vector by counting how often each word from a...

Machine Learning

Bahdanau attention

Bahdanau attention is the first attention mechanism for neural networks, introduced in 2014 to let a sequence-to-sequence decoder soft-align to every encoder...

Deep LearningModel Architecture

Bert-base-uncased model

Bert-base-uncased model Hugging Face google-bert/bert-base-uncased Name bert-base-uncased Type Natural Language Processing Task Fill-Mask Library PyTorch,...

AI ModelsLarge Language Models

Bidirectional language model

See also: Machine learning terms A bidirectional language model is a language model that, when computing a representation for a token, conditions on both the...

Large Language Models

Bigram

A bigram (also written 2-gram) is a contiguous sequence of two adjacent elements, typically two words or two characters, taken from a body of text or speech....

Machine Learning

BoolQ

BoolQ (Boolean Questions) is a natural language processing benchmark dataset of 15,942 naturally occurring yes/no question answering examples, each pairing a...

AI Benchmarks

Burstiness

Burstiness is a statistical property of a text that measures how unevenly its sentence lengths, vocabulary, and per-sentence unpredictability are distributed...

AI Tools & Products

Byte-Pair Encoding

Byte-pair encoding (BPE) is a subword tokenization algorithm that splits text into tokens by starting from individual characters or bytes and iteratively...

Large Language ModelsMachine Learning

C4 (Colossal Clean Crawled Corpus)

C4 (Colossal Clean Crawled Corpus) is a roughly 750 GB, cleaned, English-language web text dataset of about 365 million documents and 156 billion tokens that...

Data & Datasets

CRUXEval

CRUXEval (Code Reasoning, Understanding, and eXecution Evaluation) is a benchmark designed to measure how well large language models can reason about,...

AI BenchmarksAI Code Generation

CamemBERT

CamemBERT is a French monolingual language model based on the RoBERTa architecture, released in late 2019 by researchers at Inria, Facebook AI Research, and...

Large Language Models

Candidate Sampling

Candidate sampling is a family of training-time optimization techniques used in machine learning to reduce the computational cost of models that must choose...

Machine LearningNeural Networks

Causal Language Model

A causal language model (CLM), also called an autoregressive language model or a decoder-only language model, is a language model that predicts the next token...

Deep LearningMachine Learning

Chain of Density prompting

Chain of Density (CoD) is a prompting technique for abstractive text summarization with large language models, introduced in the 2023 paper "From Sparse to...

Prompt Engineering

Chain-of-Thought

Chain-of-thought (CoT) prompting is a prompt engineering technique that improves the reasoning ability of large language models by having them generate a...

Deep LearningMachine Learning

Christopher Manning

Christopher Manning is an Australian-American computer scientist and computational linguist at Stanford University who is one of the most cited researchers in...

People

Chunking (information retrieval)

Chunking is the preprocessing step in document indexing and retrieval-augmented generation (RAG) systems in which a long document or corpus is split into...

Information Retrieval

Claude (language model)

Claude is a family of large language models (LLMs) developed by Anthropic, an American artificial intelligence safety and research company. Named after Claude...

AnthropicGenerative AI

Claude Sonnet 4.5

[](/wiki/fileclaudesonnet45logo1png) Claude Sonnet 4.5 is a multimodal large language model (LLM) developed by Anthropic and released on September 29, 2025,...

AI Code GenerationAI Tools & Products

Cohere

Cohere is a Canadian artificial intelligence company that builds enterprise large language models and sells them as deployable software rather than a consumer...

AI CompaniesLarge Language Models

ColBERT

ColBERT (Contextualized Late Interaction over BERT) is a neural information retrieval model that encodes queries and documents into matrices of token-level...

Information Retrieval

Command R

Command R is a family of enterprise large language models from Cohere, launched in March 2024 and built specifically for retrieval-augmented generation (RAG),...

AI CompaniesEnterprise AI

Common Corpus

Common Corpus is the largest fully open, multilingual dataset for pretraining large language models, assembled and released by the French AI research lab...

Data & DatasetsOpen Source AI

Common Crawl

Common Crawl is a nonprofit 501(c)(3) organization that maintains a free, open repository of web crawl data, and it is the single largest publicly available...

Data & DatasetsMachine Learning

Common Pile

Common Pile v0.1 is an 8 terabyte corpus of openly licensed and public domain text, released on June 5, 2025, by EleutherAI and a consortium of more than two...

Data & DatasetsOpen Source AI

CommonsenseQA

CommonsenseQA is a multiple-choice question answering benchmark of 12,247 questions, introduced in 2019 by Alon Talmor, Jonathan Herzig, Nicholas Lourie, and...

AI Benchmarks

Computer-use agent

A computer-use agent (CUA) is a category of AI agent in artificial intelligence that performs tasks by directly operating a general-purpose computer's...

AI AgentsArtificial Intelligence

Context window

A context window (also called context length) is the maximum number of tokens that a large language model (LLM) can process at once, spanning both the input...

Artificial IntelligenceDeep Learning

Contextual AI

Contextual AI is an American enterprise artificial intelligence company headquartered in Mountain View, California, that builds production-grade systems based...

AI CompaniesInformation Retrieval

Conversational Models

Conversational models are computational systems designed to carry on a dialogue with human users in natural language, ranging from early pattern matching...

AI Models

Cosine similarity

Cosine similarity is a measure of similarity between two non-zero vectors that calculates the cosine of the angle between them, defined as the dot product of...

Machine Learning

Crash Blossom

A crash blossom is a newspaper headline that is unintentionally ambiguous because its compressed wording allows more than one valid parse, producing an...

Machine Learning

Cross-encoder

A cross-encoder is a neural network architecture that scores a pair of texts by feeding them jointly into a single transformer (such as BERT) and reading out...

Information RetrievalNeural Networks

DCLM (DataComp for Language Models)

DCLM, short for DataComp for Language Models (also styled DataComp-LM), is an open benchmark, dataset, and software framework, released in June 2024, for...

AI BenchmarksData & Datasets

DROP (Discrete Reasoning Over Paragraphs)

Discrete Reasoning Over Paragraphs Abbreviation A reading comprehension benchmark requiring discrete reasoning and mathematical operations over paragraphs ...

AI BenchmarksMachine Learning

DSPy

DSPy (short for Declarative Self-improving Python) is an open-source framework, developed at Stanford NLP, for programming rather than prompting large language...

Developer ToolsLarge Language Models

DeBERTa

DeBERTa (Decoding-enhanced BERT with Disentangled Attention) is a family of pre-trained language models developed by Microsoft Research that improves BERT and...

Deep LearningMicrosoft

Decoding strategies

Decoding strategies are the algorithms that select output tokens from a language model's next-token probability distribution during text generation. At each...

Large Language ModelsMachine Learning

Deepgram

Deepgram is an American voice artificial intelligence company, founded in 2015 and headquartered in San Francisco, that builds proprietary deep learning models...

AI CompaniesSpeech & Audio AI

Dense Passage Retrieval (DPR)

Dense Passage Retrieval (DPR) is a neural information retrieval method that uses a dual-encoder BERT architecture to map questions and passages into dense...

Information Retrieval

Direct Preference Optimization (DPO)

Direct Preference Optimization (DPO) is a method for aligning large language models with human preferences that replaces the multi-stage reinforcement learning...

AI AlignmentDeep Learning

Discrete diffusion language model

A discrete diffusion language model is a class of generative model for text that produces tokens by iteratively denoising a corrupted sequence, rather than by...

Diffusion ModelsGenerative AI

DistilBERT

DistilBERT is a compressed version of BERT released by Hugging Face in October 2019 that is 40% smaller and 60% faster than BERT-base while retaining 97% of...

AI ModelsDeep Learning

ELECTRA

ELECTRA, which stands for Efficiently Learning an Encoder that Classifies Token Replacements Accurately, is a pre-training method for natural language...

Deep LearningTransformer Models

ELIZA

ELIZA is the first widely known chatbot, a natural language processing program written by Joseph Weizenbaum at the Massachusetts Institute of Technology (MIT)...

Artificial Intelligence