Microsoft

BioGPT

BioGPT is a domain-specific generative pre-trained Transformer language model for biomedical text generation and mining, developed by Microsoft Research.

Healthcare AILarge Language Models

BitNet

BitNet is a family of large language model architectures developed by Microsoft Research Asia that constrain the weights of a transformer to extremely low bit-widths: initially a single bit ({-1, +1}) and…

Large Language ModelsModel Architecture

BitNet b1.58

BitNet b1.58 is a ternary-weight large language model architecture from Microsoft Research in which every weight is constrained to one of three values, -1, 0, or +1

Large Language ModelsModel Architecture

LongRoPE

LongRoPE is a context-window extension technique for large language models (LLMs) that use rotary position embeddings (RoPE).

Large Language ModelsModel Architecture

Microsoft 365 Copilot

Microsoft 365 Copilot is an artificial intelligence assistant developed by Microsoft that integrates large language models (LLMs) with the Microsoft 365 suite of productivity applications.

AI Tools & ProductsArtificial Intelligence

Phi (language model)

Phi is a family of open-weight small language models (SLMs) developed by Microsoft Research, beginning with Phi-1 in June 2023 and spanning thirteen-plus releases through Phi-4-reasoning-vision-15B in March…

Large Language ModelsOpen Source AI

Phi-3

AI ModelsLarge Language Models

Phi-4

Phi-4 is a 14-billion-parameter small language model developed by Microsoft Research and released in December 2024, designed to match or beat models several times its size on reasoning tasks by training…

AI ModelsLarge Language Models

YOCO (You Only Cache Once)

YOCO ("You Only Cache Once") is a decoder-decoder neural network architecture for large language models introduced by researchers at Microsoft Research and Tsinghua University in May 2024.

Large Language ModelsModel Architecture