Model merging
Model merging combines the parameters of multiple trained neural networks into a single unified model without any additional training.
Explore language models, how they work, and the techniques used to build applications with them.
Articles that also belong to these categories. Counts cover all of Large Language Models.
Showing 361-420 of 545 articles
Model merging combines the parameters of multiple trained neural networks into a single unified model without any additional training.
Moonshot AI is a Beijing-based artificial intelligence company that develops the Kimi chatbot, large language models, and agent software. The company says it was founded in early 2023.
A multi-agent system (MAS) is a system composed of multiple interacting intelligent agents that collaborate, compete, or negotiate to accomplish tasks that would be difficult or impossible for a single agent.
Multi-hop RAG is a family of retrieval-augmented generation techniques designed to answer questions that require composing evidence from two or more documents or text chunks.
Multi-token prediction (often abbreviated MTP) is a language modeling training objective in which the model is trained to predict several future tokens at each context position rather than only the next token.
Muse Glimmer is an open-weight text-and-image model developed by Meta AI for local agent and coding workloads. Meta released the model on August 10, 2026 under the identifier meta-models/Muse-Glimmer-30B.
NOSA (Native and Offloadable Sparse Attention) is a trainable sparse attention mechanism designed so that most of a language model's KV cache can live in CPU memory during decoding without the CPU-to-GPU…
NVLM (short for NVIDIA Vision Language Model), released as NVLM 1.0, is a family of open multimodal large language models developed by Nvidia.
Naver AI refers to the artificial intelligence research and products developed by Naver Corporation, South Korea's largest internet company.
Needle in a Haystack (NIAH) is a long-context evaluation that measures whether a large language model can retrieve a single fact (the "needle") inserted at a controlled position inside a long body of text (the…
Nemotron is NVIDIA's brand for its family of open large language models and the datasets, training recipes, and evaluation tools built around them.
Nemotron 3 is a family of open-weights large language model systems released by NVIDIA beginning on December 15, 2025, built for agentic AI and consisting of three sparse mixture-of-experts variants named…
NVIDIA Nemotron 3.5 Lightning is an open-weights 30 billion parameter mixture-of-experts language model with 3 billion active parameters per token, released by NVIDIA on August 11
Nemotron Nano 2 is a family of small, open-weight reasoning language models released by NVIDIA on August 18, 2025
Nemotron-4 is a family of decoder-only large language models developed by NVIDIA and documented in two technical reports released in 2024.
Nemotron-H is a family of open-weight large language models released by NVIDIA in April 2025 that replace most of the self-attention layers of a standard Transformer with Mamba-2 state-space layers, producing…
Nemotron-Labs-TwoTower is an open-weight diffusion language model released by NVIDIA in mid-2026.
Next-token prediction is the training objective used by most modern language models: the model reads a prefix of tokenized text, outputs a probability distribution over which token comes next, and training…
NoLiMa, short for "No Literal Matching," is a long-context benchmark for large language models that measures how well a model can find and use a single relevant fact buried in a long document when that fact…
North Mini Code is an open-weight large language model developed by Cohere for agentic software development and AI code generation.
Nous Research is a New York City-based applied AI research organization and company that builds widely used open-weight language models and decentralized training infrastructure.
OLMo (Open Language Model) is a family of fully open large language models built by the Allen Institute for AI (Ai2) and first released on February 1, 2024.
OLMo 2 is the second generation of fully open large language models released by the Allen Institute for AI (Ai2), spanning 7B, 13B, and 32B parameter sizes.
OLMo 3 is the third generation of fully open language models released by the Allen Institute for AI (Ai2).
OLMoE (Open Mixture-of-Experts) is a fully open sparse mixture of experts large language model released by the Allen Institute for AI (Ai2) on September 3, 2024 .
OPT (Open Pre-trained Transformer) is a suite of decoder-only large language models released by Meta AI in May 2022, ranging from 125 million to 175 billion parameters and built to reproduce the scale and…
OPUS-MT is a large collection of open, freely licensed neural machine translation models and tools produced by the Language Technology Research Group at the University of Helsinki.
ORPO (Odds Ratio Preference Optimization) is a preference alignment algorithm for large language models that merges supervised fine-tuning and preference alignment into a single training stage, eliminating the…
Ollama is a free, open-source runtime for downloading, running, and managing open-weight large language models (LLMs) locally on personal computers and servers.
Open WebUI is a self-hosted, extensible web interface for interacting with large language models (LLMs) both locally and through cloud APIs.
As of July 2026, the open-weight LLMs that are genuinely free for commercial use with no strings attached are the ones released under standard, OSI-approved licenses: Apache-2.0 (Alibaba's Qwen3, most of…
OpenAI is an American artificial intelligence research and deployment organization.
The OpenAI API is a REST-based application programming interface that gives developers programmatic access to OpenAI's family of artificial intelligence models, including the GPT series of large language…
The OpenAI o-series is a family of large language models developed by OpenAI that are trained with reinforcement learning to reason through an internal chain-of-thought before answering, making them OpenAI's…
OpenAI o1 is a family of proprietary large language models developed by OpenAI and trained to use additional computation before returning an answer.
OpenAI o1-mini is a smaller, faster, and cheaper reasoning model released by OpenAI on September 12, 2024, alongside o1-preview, and optimized for science, technology, engineering, and mathematics (STEM) tasks…
OpenAI o1-pro is the highest-compute variant of OpenAI's o1 reasoning model, designed to spend more inference-time compute so it "thinks harder" and returns the most reliable answers on the hardest…
OpenAI o3 is a family of reasoning-focused large language models developed by OpenAI and the second generation of the company's o-series reasoning models, best known for scoring 87.5% on the ARC-AGI…
OpenAI o3-mini is a reasoning-focused large language model released by OpenAI on January 31, 2025, the second commercial member of the o-series after OpenAI o1 and a smaller, cheaper
OpenAI o3-pro is a high-compute reasoning large language model released by OpenAI on June 10, 2025, designed as the professional, higher-reliability variant of the company's o3 reasoning model.
OpenOrca is a large open-source instruction-tuning dataset that augments the FLAN Collection with chain-of-thought responses generated by OpenAI's GPT-3.5 and GPT-4 APIs.
OpenRouter is a unified API gateway and marketplace that routes a single, OpenAI-compatible request across more than 400 large language models (LLMs) and other AI models from over 60 providers, automatically…
Outlines is an open-source Python (programming language) library, released under the Apache 2.0 license, that constrains large language model output to user-specified structures: regular expressions, function…
Ox Alpha was the anonymous preview alias for GLM-5.3-Flash, a natively multimodal large language model developed by Z.ai.
PaLM (Pathways Language Model) is a family of dense, decoder-only large language models developed by Google Research. Google announced the original family on April 4, 2022.
PaLM 2 is the large language model Google announced on May 10, 2023, at its I/O developer conference as the successor to the original PaLM (Pathways Language Model).
Patchscopes is an interpretability framework for inspecting hidden representations of large language models by patching an internal activation from a source computation into a separate target inference whose…
Persona vectors are single linear directions in the activation space of a large language model that correspond to high level character traits such as evil, sycophancy, or a propensity to hallucinate.
Phi is a family of open-weight small language models (SLMs) developed by Microsoft Research, beginning with Phi-1 in June 2023 and spanning thirteen-plus releases through Phi-4-reasoning-vision-15B in March…
Phi-4 is a 14-billion-parameter small language model developed by Microsoft Research and released in December 2024, designed to match or beat models several times its size on reasoning tasks by training…
Phi-4-reasoning is a 14 billion parameter open weight reasoning model released by Microsoft Research on April 30, 2025.
Phi-4-mini is a 3.8 billion parameter open weight small language model released by Microsoft on February 26, 2025, under the permissive MIT license.
Phi-4-mini-flash-reasoning is a 3.8 billion parameter open weight reasoning model released by Microsoft in July 2025.
PiSSA (Principal Singular values and Singular vectors Adaptation) is a parameter-efficient fine-tuning method for large language models that initializes LoRA-style low-rank adapter matrices from the dominant…
Pipeline parallelism (often abbreviated PP) is a distributed training strategy that splits the layers of a deep neural network across multiple accelerator devices so that each device holds one contiguous block…
Pixtral is a family of multimodal vision-language models developed by Mistral AI, a French AI company founded in April 2023.
Pixtral Large is a 124-billion-parameter multimodal (vision-language) large language model released by Mistral AI on November 18, 2024.
Post-training is the stage of large language model (LLM) development that comes after pre-training and turns a raw, general-purpose base model into an aligned, instruction-following AI assistant.
A prompt is the input given to a generative AI model, particularly a large language model (LLM), that elicits a desired response.