Large Language Models

BioGPT

BioGPT is a domain-specific generative pre-trained Transformer language model for biomedical text generation and mining, developed by Microsoft Research.

Healthcare AIMicrosoft

BitNet

BitNet is a family of large language model architectures developed by Microsoft Research Asia that constrain the weights of a transformer to extremely low bit-widths: initially a single bit ({-1, +1}) and…

MicrosoftModel Architecture

BitNet b1.58

BitNet b1.58 is a ternary-weight large language model architecture from Microsoft Research in which every weight is constrained to one of three values, -1, 0, or +1

MicrosoftModel Architecture

LongRoPE

LongRoPE is a context-window extension technique for large language models (LLMs) that use rotary position embeddings (RoPE).

MicrosoftModel Architecture

Microsoft 365 Copilot

Microsoft 365 Copilot is an artificial intelligence assistant developed by Microsoft that integrates large language models (LLMs) with the Microsoft 365 suite of productivity applications.

AI Tools & ProductsArtificial Intelligence

Phi (language model)

Phi is a family of open-weight small language models (SLMs) developed by Microsoft Research, beginning with Phi-1 in June 2023 and spanning thirteen-plus releases through Phi-4-reasoning-vision-15B in March…

MicrosoftOpen Source AI

Phi-3

AI ModelsMicrosoft

Phi-4

Phi-4 is a 14-billion-parameter small language model developed by Microsoft Research and released in December 2024, designed to match or beat models several times its size on reasoning tasks by training…

AI ModelsMicrosoft

YOCO (You Only Cache Once)

YOCO ("You Only Cache Once") is a decoder-decoder neural network architecture for large language models introduced by researchers at Microsoft Research and Tsinghua University in May 2024.

MicrosoftModel Architecture