Showing 421-480 of 491 articles
Self-Instruct
Self-Instruct is a semi-automated framework for aligning a pretrained large language model with instruction-following behavior by bootstrapping its training...
Data & DatasetsTraining & Optimization
Self-Refine
Self-Refine is an inference-time prompting framework in which a single large language model iteratively improves its own output by alternating between...
Prompt Engineering
Self-Rewarding Language Models
Self-Rewarding Language Models (SRLM) is an iterative alignment method in which a single large language model alternately plays the role of policy (generating...
AI AlignmentTraining & Optimization
Self-consistency
Self-consistency is a decoding strategy for large language models that samples multiple chain-of-thought reasoning paths for the same question and returns the...
Prompt EngineeringReasoning Models
SimPO
SimPO (Simple Preference Optimization) is a reference-free offline preference learning algorithm for aligning large language models with human preferences. It...
AI AlignmentTraining & Optimization
Skywork R1V
Skywork R1V is a family of open-weight multimodal vision-language models built for chain-of-thought reasoning, developed by Skywork AI, the large-model team of...
AI Models
SlimPajama
SlimPajama is a 627-billion-token English-language pre-training corpus for large language models, produced by Cerebras Systems in collaboration with the...
Data & DatasetsOpen Source AI
Small language model
A small language model (SLM) is a compact large language model, typically under about 10 billion parameters, built to run efficiently on a single consumer GPU,...
Machine Learning
SmolLM
SmolLM is a family of small, fully open language models released by Hugging Face on July 16, 2024 in three sizes, 135 million, 360 million, and 1.7 billion...
AI ModelsOpen Source AI
SmolLM 2
SmolLM 2 is a family of compact open-weight language models released by Hugging Face on November 1, 2024. The family contains three sizes, 135M, 360M, and 1.7...
AI ModelsOpen Source AI
SmolLM 3
SmolLM 3 is a fully open 3 billion parameter language model released by Hugging Face on July 8, 2025, trained on 11.2 trillion tokens and designed as a small,...
AI ModelsOpen Source AI
SmoothQuant
SmoothQuant is a training-free, accuracy-preserving post-training quantization (PTQ) method that enables 8-bit weight and 8-bit activation (W8A8) integer...
AI Inference
Snowflake AI
Snowflake AI is the suite of artificial intelligence and machine learning capabilities built into the Snowflake AI Data Cloud, anchored by Cortex AI (managed...
AI CompaniesAI Infrastructure
Snowflake Arctic
Snowflake Arctic is an open large language model released by Snowflake AI Research on April 24, 2024.[1][2][10] It uses a Dense Mixture of Experts (Dense-MoE)...
AI CompaniesMixture of Experts
Speculative Decoding
See also: transformer, large language model, inference, KV cache, autoregressive model, knowledge distillation Speculative decoding is a lossless inference...
AI InferenceDeep Learning
SpiRit-LM
SpiRit-LM (also written Spirit LM) is a large language model from Meta AI's Fundamental AI Research (FAIR) group that handles spoken and written language...
Meta AISpeech & Audio AI
StarCoder
StarCoder is a family of open-access large language models for code generation and code understanding, developed by the BigCode project, an open scientific...
AI Code GenerationOpen Source AI
Step-3
Step-3 is an open-weight large multimodal mixture of experts (MoE) model released in July 2025 by StepFun, the Shanghai-based Chinese artificial intelligence...
AI Models
Step-Back Prompting
Step-Back Prompting is a two-stage prompting technique introduced by researchers at Google DeepMind in October 2023. It elicits stronger reasoning from large...
Prompt Engineering
StepFun
StepFun (Chinese: 阶跃星辰, pinyin: Jiēyuè Xīngchén), formally Shanghai Jieyue Xingchen Intelligent Technology Co., Ltd., is a Shanghai-based Chinese artificial...
AI CompaniesChinese AI
StreamingLLM
StreamingLLM is an inference-time technique that allows pretrained transformer language models, originally trained with a finite attention window, to process...
AI Inference
Structured output
Structured output is a set of techniques and API features that constrain a large language model (LLM) to emit responses that exactly conform to a predefined...
Artificial IntelligenceDeveloper Tools
SubQ
SubQ is a large language model released on May 5, 2026 by Subquadratic, a Miami-based startup that emerged from stealth claiming to have built the first...
AI CompaniesModel Architecture
Switch Transformer
The Switch Transformer is a sparsely activated Mixture of Experts (MoE) Transformer architecture introduced by William Fedus, Barret Zoph, and Noam Shazeer at...
GoogleMixture of Experts
Sycophancy (artificial intelligence)
Sycophancy in artificial intelligence is the tendency of large language models to tell users what they want to hear: tailoring responses to match a user's...
AI AlignmentAI Safety
System prompt
A system prompt is a special set of instructions, guidelines, persona definitions, and contextual information given to a large language model (LLM) before any...
AI SafetyPrompt Engineering
T5 (language model)
T5 (Text-to-Text Transfer Transformer) is a family of transformer-based language models released by Google in 2019-2020 that reframes every natural language...
Transformer Models
Tang Jie
Tang Jie (Chinese: 唐杰; born 1977), also published as Jie Tang, is a Chinese computer scientist, a chair professor at Tsinghua University, and the co-founder...
Chinese AIPeople
Temperature (artificial intelligence)
Temperature is a hyperparameter that controls the randomness of a large language model's output by scaling the model's raw scores, called logits, before they...
Machine LearningNatural Language Processing
Tencent AI
Tencent AI is the artificial intelligence research, products, and services developed by Tencent Holdings Ltd., one of the world's largest technology companies,...
AI CompaniesChinese AI
Tencent Hunyuan Hy3
Tencent Hunyuan Hy3 (released as Hy3-preview) is an open-weights large language model published by Tencent on April 23, 2026. It is a Mixture-of-Experts (MoE)...
Chinese AIMixture of Experts
Tensor Parallelism
Tensor parallelism (TP) is a distributed training technique that splits the individual weight matrices of a neural network layer across multiple devices, so...
AI InfrastructureTraining & Optimization
Test-time compute
Test-time compute (also called inference-time compute scaling or test-time scaling) is the practice of allocating additional computation while a large language...
Artificial IntelligenceMachine Learning
Tokenization
Tokenization is the process of breaking text into smaller units called tokens, which serve as the fundamental input to natural language processing (NLP)...
Machine LearningNatural Language Processing
Tokens per second
Tokens per second (TPS) is a key performance metric for measuring the speed of large language model (LLM) inference. It quantifies how many tokens a model can...
AI BenchmarksAI Hardware
Tongyi Qianwen
Tongyi Qianwen (通义千问), the brand often glossed in English as "seeking truth by asking a thousand questions," is Alibaba Group's flagship large language model...
Chinese AIConversational AI
Tool use
Tool use is the ability of large language models (LLMs) and AI systems to interact with external tools, APIs, databases, and software functions during...
AI AgentsArtificial Intelligence
Toolformer
Toolformer is a research language model from Meta AI that learns, in a self-supervised way, to call external software tools through simple text-based API...
AI AgentsMeta AI
Top-p and top-k sampling
Top-p sampling, also called nucleus sampling, is a text-generation decoding method for large language models (LLMs) that, at each step, samples the next token...
Machine LearningNatural Language Processing
Top-p sampling
Top-p sampling, also called nucleus sampling, is a stochastic decoding method for text generation in which the model samples from the smallest possible set of...
Machine LearningNatural Language Processing
TxT360
TxT360 is an open large-scale pretraining corpus for large language models, released in October 2024 by the LLM360 project, a collaboration led by Petuum and...
Data & DatasetsOpen Source AI
UltraChat
UltraChat is a large-scale synthetic multi-turn instructional conversation dataset released in May 2023 by the OpenBMB group at Tsinghua University, comprising...
Chinese AIData & Datasets
Unidirectional language model
See also: Machine learning terms A unidirectional language model is a language model that predicts each token using only the tokens that come before it in the...
Natural Language Processing
VeRA (Vector-based Random Matrix Adaptation)
Vector-based Random Matrix Adaptation (VeRA) is a parameter-efficient fine-tuning (PEFT) method for adapting large pretrained neural networks to downstream...
Training & Optimization
Vicuna (language model)
Vicuna is a family of open-source chat-tuned large language models released by LMSYS (the Large Model Systems Organization) in 2023, produced by fine-tuning...
Artificial IntelligenceOpen Source AI
Vision language model
A vision-language model (VLM) is a class of multimodal artificial intelligence model that jointly processes visual inputs (typically still images, sometimes...
Computer VisionMultimodal AI
Voxtral
Voxtral is a family of open-weight speech-understanding models released by Mistral AI on July 15, 2025, under the Apache 2.0 license. It ships in two sizes,...
Open Source AISpeech & Audio AI
Voyager (Minecraft LLM agent)
Voyager is an open-ended embodied agent that uses a large language model to play Minecraft by writing, executing, and storing JavaScript programs against the...
AI AgentsAI in Gaming
WRAP (Web Rephrase Augmented Pre-training)
WRAP (Web Rephrase Augmented Pre-training) is a synthetic-data pre-training method introduced in the paper "Rephrasing the Web: A Recipe for Compute and...
Data & DatasetsTraining & Optimization
WizardLM
WizardLM is a family of open-weights instruction-tuned LLaMA-derived large language models and an associated data-synthesis methodology, both produced by a...
Open Source AI
WordPiece
WordPiece is a subword tokenization algorithm that builds a fixed-size vocabulary of word pieces by repeatedly merging the symbol pair whose combination most...
Natural Language Processing
Writer (AI company)
Writer is a generative artificial intelligence company headquartered in San Francisco, California, that develops a full-stack enterprise AI platform built on...
AI CompaniesEnterprise AI
WritingBench
WritingBench is a comprehensive benchmark for evaluating the generative writing capabilities of large language models (LLMs) across diverse real-world writing...
AI BenchmarksNatural Language Processing
Wu Dao
Wu Dao (Chinese: 悟道, roughly "enlightenment" or "understanding the way") is a series of large pretrained models built by the Beijing Academy of Artificial...
AI HistoryChinese AI
XLM-RoBERTa
XLM-RoBERTa (often abbreviated XLM-R) is a multilingual masked language model developed by Facebook AI Research (now Meta AI) and released in November 2019. It...
Natural Language Processing
YOCO (You Only Cache Once)
YOCO ("You Only Cache Once") is a decoder-decoder neural network architecture for large language models introduced by researchers at Microsoft Research and...
MicrosoftModel Architecture
Yang Zhilin
Yang Zhilin (Chinese: 杨植麟; pinyin: Yáng Zhílín) is the co-founder and chief executive officer of Moonshot AI (月之暗面), the Beijing startup that develops the Kimi...
Chinese AIPeople
Yi (language model)
Yi is a series of open, bilingual (English and Chinese) large language models developed by the Chinese startup 01.AI (Chinese: 零一万物, Lingyiwanwu), the company...
Chinese AIOpen Source AI
Yi-Large
Yi-Large is a closed-source large language model developed by Chinese artificial intelligence company 01.AI (零一万物, Língyi Wànwù), founded by Kai-Fu Lee....
AI ModelsChinese AI
Yi-Lightning
Yi-Lightning is a closed-source large language model developed by Chinese artificial intelligence company 01.AI (零一万物, Língyī Wànwù), the company founded by...
AI ModelsChinese AI