Showing 61-120 of 226 articles
ELMo (Embeddings from Language Models)
ELMo (Embeddings from Language Models) is a deep contextualized word embedding method, introduced in 2018 by the Allen Institute for AI (AI2) and the...
AI HistoryAI Models
Embedding Layer
An embedding layer is a neural network component that acts as a trainable lookup table, mapping discrete integer indices (such as word IDs, user IDs, or...
Machine LearningNeural Networks
Embedding vector
An embedding vector is a dense, fixed-length array of real numbers that represents a discrete object (such as a word, sentence, image, audio clip, or graph...
Embeddings
Embeddings are dense vector representations of data in a continuous vector space, where semantically similar items are mapped to nearby points. An embedding...
Deep LearningInformation Retrieval
Emily M. Bender
Emily M. Bender is an American linguist and a professor in the Department of Linguistics at the University of Washington, where she directs the Computational...
AI EthicsPeople
FLORES-200
FLORES-200 is a multilingual evaluation benchmark for machine translation systems, covering 200 languages across a wide range of language families, scripts,...
AI Benchmarks
Falcon (language model)
Falcon is a family of open-source large language models built by the Technology Innovation Institute (TII), the applied-research pillar of the Abu Dhabi...
Large Language ModelsOpen Source AI
Fill-Mask Models
See also: Natural Language Processing Models and Tasks Fill-mask models are language models trained with a masked language modeling (MLM) objective, in which a...
AI Models
FineWeb
FineWeb is a large-scale, open pretraining dataset for large language models (LLMs) created by Hugging Face. Released in April 2024, it contains approximately...
Data & DatasetsMachine Learning
Full Softmax
Full softmax (also called the standard softmax or exact softmax) is the softmax computation that calculates a probability for every possible output class in a...
Deep LearningMachine Learning
GLUE benchmark
The General Language Understanding Evaluation (GLUE) benchmark is a collection of nine natural language understanding (NLU) tasks designed to evaluate and...
AI BenchmarksMachine Learning
GPT-1
GPT-1 is the first model in the GPT (Generative Pre-trained Transformer) series, a 117-million-parameter, 12-layer decoder-only Transformer released by OpenAI...
Large Language ModelsOpenAI
GPT-2
GPT-2 is a 1.5 billion parameter language model released by OpenAI in February 2019, and the second model in the GPT (Generative Pre-trained Transformer)...
Large Language ModelsOpenAI
GPT-3
GPT-3 (Generative Pre-Trained Transformer 3) is a 175-billion-parameter large language model developed by OpenAI and released as a beta API on June 11, 2020,...
Large Language ModelsOpenAI
GPT-4
GPT-4 (Generative Pre-trained Transformer 4) is a large language model developed by OpenAI and released on March 14, 2023. It was the fourth main entry in the...
Generative AILarge Language Models
Gemini (language model)
Gemini is a family of natively multimodal large language models developed by Google DeepMind, first announced on December 6, 2023, that can reason across text,...
Generative AIGoogle DeepMind
GloVe (Global Vectors for Word Representation)
GloVe (Global Vectors for Word Representation) is an unsupervised learning algorithm that turns words into dense numeric vectors by factorizing a word-word...
AI History
Global-MMLU
Global-MMLU is a multilingual evaluation benchmark that extends the MMLU question-answering dataset across 42 languages, with designated subsets labeled...
AI BenchmarksModel Evaluation
Greedy decoding
Greedy decoding (also called greedy search or argmax decoding) is the simplest text-generation strategy used by autoregressive language models: at every step...
Large Language Models
Grounding (artificial intelligence)
Grounding in artificial intelligence is the process of anchoring an AI system's outputs to verifiable, real-world information so that each claim can be traced...
AI SafetyArtificial Intelligence
Hallucination
Hallucination in artificial intelligence is the generation of output that is fluent, confident, and plausible but factually incorrect, fabricated, or not...
AI SafetyMachine Learning
Haystack (framework)
Haystack is an open-source AI orchestration framework developed by deepset, a Berlin-based company, for building production-ready natural language processing...
Developer ToolsInformation Retrieval
HellaSwag
HellaSwag is a commonsense reasoning benchmark for language models, introduced by Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi in the...
AI Benchmarks
HotpotQA
HotpotQA is a large-scale, multi-hop question answering dataset of about 112,779 crowd-authored question-and-answer pairs over English Wikipedia, whose answers...
AI BenchmarksArtificial Intelligence
How to Pressure LLMs for Better Output
See also: Prompt engineering, Chain-of-thought prompting, LLM anxiety, and Large language model Pressuring large language models (LLMs) is a family of prompt...
Large Language ModelsPrompt Engineering
HyDE (Hypothetical Document Embeddings)
HyDE (Hypothetical Document Embeddings) is a zero-shot dense retrieval technique that, instead of searching with the user's query, first prompts an...
Information Retrieval
IFEval
IFEval (Instruction-Following Evaluation) is a benchmark of 541 prompts that measures how reliably large language models obey explicit, machine-checkable...
AI BenchmarksLarge Language Models
In-Context Learning
In-context learning (ICL) is the ability of a large language model to learn a new task at inference time by conditioning on a prompt that contains a few...
Deep LearningLarge Language Models
InfiniteBench
InfiniteBench (stylized as ∞Bench) is a long-context benchmark that tests whether large language models (LLMs) can genuinely process and reason over inputs...
AI BenchmarksLarge Language Models
Information Retrieval
Information retrieval (IR) is the science and practice of finding relevant documents, passages, or data from large unstructured collections in response to a...
Information RetrievalMachine Learning
Instruction Tuning
Instruction tuning is the post-pretraining training stage in which a large language model (LLM) is fine-tuned on a curated collection of (instruction,...
Deep LearningLarge Language Models
Jacob Devlin
Jacob Devlin is an American research scientist in natural language processing and machine learning, best known as the first author of BERT, the bidirectional...
People
Jina Embeddings v3
Jina Embeddings v3 is a multilingual text embedding model released by Jina AI on September 18, 2024, with 570 million parameters, support for 89 languages, an...
AI ModelsInformation Retrieval
Knowledge Editing
Knowledge editing (also called model editing) is a family of techniques for updating or correcting specific factual associations stored in the weights of a...
Large Language ModelsMachine Learning
LAMBADA
LAMBADA (LAnguage Modeling Broadened to Account for Discourse Aspects) is a benchmark dataset designed to evaluate the ability of computational language models...
AI Benchmarks
LLaMA
LLaMA (Large Language Model Meta AI), stylized as Llama from version 2 onward, is a family of open-weight large language models developed by Meta AI (formerly...
Large Language ModelsMeta AI
Language Model
A language model is a probabilistic model that assigns a probability to a sequence of words or tokens in a natural language, most often by estimating the...
Deep LearningMachine Learning
Large Concept Model
A Large Concept Model (LCM) is a research approach to language modeling, introduced by Meta AI's Fundamental AI Research (FAIR) group in December 2024, that...
Meta AIModel Architecture
Large Language Model
See also: Machine learning terms, Natural language processing, Transformer A large language model (LLM) is an artificial intelligence system built on a...
Artificial IntelligenceDeep Learning
Latent Dirichlet allocation
Latent Dirichlet allocation (LDA) is a generative probabilistic model that discovers the hidden thematic structure in a collection of documents by treating...
Artificial IntelligenceMachine Learning
Latent semantic analysis (LSA)
Latent semantic analysis (LSA), called latent semantic indexing (LSI) in information retrieval contexts, is an unsupervised technique that maps both terms and...
Information RetrievalMathematics
LegalBench
LegalBench is a collaboratively constructed benchmark for measuring legal reasoning in large language models (LLMs), consisting of 162 tasks that span six...
AI BenchmarksLarge Language Models
LibriSpeech
LibriSpeech is a freely available corpus of approximately 1,000 hours of 16 kHz read English speech that serves as the standard benchmark for training and...
AI BenchmarksSpeech & Audio AI
LiveBench
LiveBench Description 2024-06-12 Latest version 2026-01-08 Authors Abacus.AI, NYU, NVIDIA, University of Maryland, USC Technical Details Type Text...
AI BenchmarksMachine Learning
Llama 3
Llama 3 is a family of open-weight large language models released by Meta on April 18, 2024, and described by Meta at launch as "the most capable openly...
AI ModelsLarge Language Models
LlamaIndex
LlamaIndex is an open-source data framework for building large language model (LLM) applications, with a particular focus on retrieval-augmented generation...
Developer ToolsInformation Retrieval
LoRA (Low-Rank Adaptation)
LoRA (Low-Rank Adaptation) is a parameter-efficient fine-tuning technique that freezes a pre-trained model's weights and trains small, injected low-rank...
Deep LearningMachine Learning
LongBench
LongBench is a benchmark suite for evaluating the long-context understanding capabilities of large language models (LLMs). Developed by researchers at Tsinghua...
AI BenchmarksLarge Language Models
Longformer
Longformer is a transformer architecture for processing long documents, introduced by Iz Beltagy, Matthew E. Peters, and Arman Cohan of the Allen Institute for...
Large Language ModelsTransformer Models
METEOR (metric)
METEOR (Metric for Evaluation of Translation with Explicit ORdering) is an automatic evaluation metric for machine translation and other text-generation tasks...
Machine LearningModel Evaluation
MGSM (Multilingual Grade School Math)
Multilingual Grade School Math Abbreviation A multilingual benchmark evaluating mathematical reasoning across 10 typologically diverse languages using...
AI Benchmarks
MMTEB
MMTEB (Massive Multilingual Text Embedding Benchmark) is a large, community-built suite for evaluating text embedding models across more than 500...
AI BenchmarksInformation Retrieval
MT-Bench
MT-Bench (Multi-Turn Benchmark) is a benchmark of 80 hand-written, two-turn questions that evaluates large language models (LLMs) on multi-turn conversation...
AI BenchmarksLarge Language Models
MTEB (Massive Text Embedding Benchmark)
MTEB, short for Massive Text Embedding Benchmark, is the standard public leaderboard for evaluating text embedding models across many task types at once. It...
AI BenchmarksArtificial Intelligence
Machine learning terms/Natural Language Processing
Natural Language Processing (NLP) is the subfield of artificial intelligence and machine learning concerned with enabling computers to read, interpret,...
Large Language ModelsMachine Learning
Machine translation
Machine translation (MT) is the use of software to automatically translate text or speech from one natural language to another without human intervention. As...
Artificial IntelligenceMachine Learning
Masked Language Model
A masked language model (MLM) is a language model trained to predict missing tokens that have been hidden in a sequence of text, using context from both the...
Deep LearningMachine Learning
MathArena
MathArena: Evaluating LLMs on Uncontaminated Math Competitions Description March 2025 (USAMO 2025 evaluation), May 2025 (paper) Latest expansion Mislav...
AI BenchmarksArtificial Intelligence
Matryoshka representation learning
Matryoshka Representation Learning (MRL) is a representation learning technique that trains a single neural model to produce embedding vectors which remain...
Information RetrievalMachine Learning
MedQA
MedQA is a large-scale, open-domain medical question answering benchmark of multiple-choice questions taken from real medical licensing examinations,...
AI BenchmarksHealthcare AI