Showing 361-420 of 491 articles
Outlines (library)
Outlines is an open-source Python (programming language) library, released under the Apache 2.0 license, that constrains large language model output to...
Developer ToolsOpen Source AI
PaLM
PaLM (Pathways Language Model) is a family of large language models developed by Google Research. The original PaLM, announced on April 4, 2022, was a...
Google DeepMindNatural Language Processing
PaLM 2
PaLM 2 is the large language model Google announced on May 10, 2023, at its I/O developer conference as the successor to the original PaLM (Pathways Language...
Patchscopes
Patchscopes is an interpretability framework for inspecting hidden representations of large language models by patching an internal activation from a source...
Interpretability
Persona vectors
Persona vectors are single linear directions in the activation space of a large language model that correspond to high level character traits such as evil,...
AI SafetyInterpretability
Phi (language model)
Phi is a family of open-weight small language models (SLMs) developed by Microsoft Research, beginning with Phi-1 in June 2023 and spanning thirteen-plus...
MicrosoftOpen Source AI
Phi-3
<p><b>Phi-3</b> is a family of small, efficient open-weight language models developed by Microsoft and first released on April 23, 2024, under the permissive...
AI ModelsMicrosoft
Phi-4
Phi-4 is a 14-billion-parameter small language model developed by Microsoft Research and released in December 2024, designed to match or beat models several...
AI ModelsMicrosoft
Phi-4 Reasoning
Phi-4-reasoning is a 14 billion parameter open weight reasoning model released by Microsoft Research on April 30, 2025. It was launched together with...
AI ModelsOpen Source AI
Phi-4-mini
Phi-4-mini is a 3.8 billion parameter open weight small language model released by Microsoft on February 26, 2025, under the permissive MIT license.[1][4] It...
AI ModelsOpen Source AI
Phi-4-mini-flash-reasoning
Phi-4-mini-flash-reasoning is a 3.8 billion parameter open weight reasoning model released by Microsoft in July 2025.[1] It is a latency optimized sibling of...
AI ModelsOpen Source AI
PiSSA
PiSSA (Principal Singular values and Singular vectors Adaptation) is a parameter-efficient fine-tuning method for large language models that initializes...
Training & Optimization
Pipeline Parallelism
Pipeline parallelism (often abbreviated PP) is a distributed training strategy that splits the layers of a deep neural network across multiple accelerator...
AI InfrastructureTraining & Optimization
Pixtral
Pixtral is a family of multimodal vision-language models developed by Mistral AI, a French AI company founded in April 2023. The family consists of two models:...
AI CompaniesAI Models
Pixtral Large
Pixtral Large is a 124-billion-parameter multimodal (vision-language) large language model released by Mistral AI on November 18, 2024. It pairs a...
AI ModelsOpen Source AI
Post-training
Post-training is the stage of large language model (LLM) development that comes after pre-training and turns a raw, general-purpose base model into an aligned,...
Artificial IntelligenceDeep Learning
Prompt
A prompt is the input given to a generative AI model, particularly a large language model (LLM), that elicits a desired response. In the simplest case, a...
Prompt Engineering
Prompt Caching
Prompt caching is an large language model (LLM) inference optimization that stores the computed key-value (KV) state of a repeated prompt prefix so it can be...
Machine Learning
Prompt Engineering
Prompt engineering is the practice of designing, structuring, and refining the text inputs (prompts) given to a generative AI model so that it produces a...
Machine LearningNatural Language Processing
Prompt injection
Prompt injection is a class of security vulnerabilities in which an attacker crafts malicious input designed to override, subvert, or manipulate the...
AI Safety
Proprietary vs. Open Source Large Language Models (LLMs)
See also: LLMs, GPT-4, Llama, Apache 2.0 License The split between proprietary and open-source large language models (LLMs) is one of the defining structural...
Open Source AI
QLoRA
QLoRA (Quantized Low-Rank Adaptation) is a parameter-efficient fine-tuning method that finetunes a 65-billion-parameter large language model on a single 48 GB...
AI InferenceDeep Learning
QwQ
Alibaba Cloud Qwen team Series November 28, 2024 (QwQ-32B-Preview) Full release Large language model (reasoning model) Architecture 32.5 billion...
Chinese AIOpen Source AI
Qwen
Qwen is a family of open-source and proprietary large language models (LLMs) and multimodal models developed by Alibaba Cloud, the cloud computing division of...
Chinese AINatural Language Processing
Qwen2
Qwen2 is the second major generation of open large language models developed by the Qwen team at Alibaba Cloud, released on 6 June 2024. [1][3] It shipped in...
Chinese AIOpen Source AI
Qwen2-Math
Qwen2-Math is a series of mathematics-specialized large language models released by the Qwen team at Alibaba on 8 August 2024. The series consists of three...
Chinese AIMathematics
Qwen2.5
Qwen2.5 is a family of open-weight large language models that Alibaba Cloud's Qwen team released on 19 September 2024, spanning seven dense sizes from 0.5...
Chinese AIOpen Source AI
Qwen2.5-Coder
Qwen2.5-Coder is the code-specialized series within the Qwen2.5 generation of large language models developed by the Qwen team at Alibaba. It is the successor...
AI Code GenerationChinese AI
Qwen3
Qwen3 is the third-generation family of large language models developed by the Qwen Team at Alibaba Cloud (also known as Tongyi Qianwen lab). Released on April...
AI ModelsChinese AI
Qwen3 Embedding
Qwen3 Embedding is a family of open text embedding and reranking models released by Alibaba's Qwen team in June 2025. The series comes in three sizes, 0.6...
Chinese AIInformation Retrieval
Qwen3-Coder
Qwen3-Coder is a family of open-weight large language models specialized for software engineering, developed by Alibaba's Qwen team (Tongyi Lab) and released...
Chinese AIDeveloper Tools
Qwen3-Max
Qwen3-Max is the flagship large language model in Alibaba's Qwen series and the first Qwen model to cross one trillion parameters, released in preview on...
AI ModelsChinese AI
Qwen3-Next
Qwen3-Next is an efficiency-focused large language model and model architecture released in September 2025 by the Qwen team at Alibaba Cloud. The flagship...
AI ModelsOpen Source AI
Qwen3-Omni
Qwen3-Omni is a natively end-to-end omni-modal foundation model developed by the Qwen team at Alibaba Cloud, capable of understanding text, images, audio, and...
Chinese AIMultimodal AI
Qwen3-VL
Qwen3-VL is a family of open-weight vision-language models built by the Qwen team at Alibaba Cloud, first released in September 2025. It is the multimodal...
Chinese AIMultimodal AI
Qwen3.5
Qwen3.5 is a family of open-weight large language models developed by the Qwen team at Alibaba, the successor to the Qwen3 series. [1][2] The line debuted on...
Chinese AIOpen Source AI
Qwen3.6
Qwen3.6 is a generation of large language models from the Qwen team at Alibaba, released in April 2026 as the successor to Qwen3.5. [1][2] The line keeps the...
Chinese AIOpen Source AI
Qwen3.7-Max
Qwen3.7-Max is a closed-weight frontier large language model developed by Alibaba's Qwen team, announced in May 2026 as the flagship of the Qwen3.7 generation....
Chinese AI
RULER (benchmark)
RULER: What's the Real Context Size of Your Long-Context Language Models? Abbreviation A synthetic benchmark for evaluating long-context large language...
AI Benchmarks
RWKV-7 (Goose)
RWKV-7, codenamed Goose, is an attention-free, RNN-style large-language-model architecture introduced in March 2025 that runs inference in linear time with...
AI ResearchNeural Networks
Reasoning (artificial intelligence)
Reasoning in artificial intelligence is the ability of an AI system to draw inferences, solve problems, and make decisions through structured, multi-step...
Artificial IntelligenceMachine Learning
Reasoning models
Reasoning models are a class of large language models trained, typically through reinforcement learning on long chain-of-thought traces, to perform an extended...
Artificial IntelligenceMachine Learning
RecurrentGemma
RecurrentGemma is a family of open-weight language models released by Google DeepMind that is built on the Griffin architecture rather than the standard...
Google DeepMindOpen Source AI
RefinedWeb
RefinedWeb is a large-scale English pretraining dataset for large language models, built from filtered and deduplicated Common Crawl web data alone and...
Data & DatasetsOpen Source AI
Refusal direction
The refusal direction is a finding from mechanistic interpretability research that the refusal behavior of safety fine-tuned chat language models is mediated...
AI SafetyInterpretability
Reka AI
Reka AI (commonly referred to as Reka) is an artificial intelligence research and product company, founded in 2022 by former Google DeepMind, Google Brain,...
AI CompaniesMultimodal AI
Reka Core
Reka Core is a frontier class multimodal foundation model developed by Reka AI, a research and product company founded in 2022 by former scientists from...
AI ModelsMultimodal AI
Reka Edge
Reka Edge is a 7-billion-parameter multimodal language model developed by Reka AI, introduced in April 2024 as the smallest member of the company's first...
AI ModelsMultimodal AI
Reka Flash
Reka Flash is a family of multimodal large language models developed by Reka AI, a San Francisco Bay Area research company founded in 2022 by former...
AI ModelsMultimodal AI
Retrieval-Augmented Generation
Retrieval-Augmented Generation (RAG) is a technique in natural language processing that augments a generative model with an information-retrieval component, so...
Machine LearningNatural Language Processing
Ring-1T
Ring-1T is an open-weight reasoning model released in October 2025 by inclusionAI, the open-source research initiative associated with Ant Group, the...
AI ModelsOpen Source AI
Rotary Position Embedding
Rotary Position Embedding (RoPE) is a positional encoding method for transformer models that encodes a token's absolute position by rotating its query and key...
Deep LearningModel Architecture
SGLang
SGLang (short for Structured Generation Language) is a high-performance, open-source serving framework for large language models and multimodal models,...
AI Tools & ProductsMachine Learning
SPIN (Self-Play Fine-Tuning)
SPIN (Self-Play fIne-tuNing) is a post-training method for large language models introduced by researchers at the University of California, Los Angeles (UCLA)...
AI AlignmentTraining & Optimization
Salesforce AI
Salesforce AI is the suite of artificial intelligence products, research initiatives, and platform capabilities developed by Salesforce, the San...
AI CompaniesEnterprise AI
SantaCoder
SantaCoder is a 1.1 billion parameter large language model for code generation, released in early 2023 by the BigCode project, an open scientific collaboration...
AI Code Generation
Scaling Laws
Neural scaling laws are empirical, power-law relationships that describe how the performance of neural networks in artificial intelligence improves predictably...
Deep LearningMachine Learning
Scaling Laws for Neural Language Models
Scaling Laws for Neural Language Models is a landmark research paper published by OpenAI on January 23, 2020 (arXiv:2001.08361) that established that the test...
AI ResearchMachine Learning
SciBERT
SciBERT is a BERT-based language model pretrained from scratch on a large corpus of scientific papers, built by the Allen Institute for AI (AI2). It was...
AI ModelsNatural Language Processing
Self-Discover prompting
Self-Discover is a prompting framework for large language models in which the model first composes a task-specific reasoning structure from a library of atomic...
Prompt Engineering