Attention-FFN disaggregation
Attention-FFN disaggregation (AFD), also written attention-feedforward disaggregation or A/F disaggregation, is a large language model serving architecture that runs the attention sublayers and the…
Machine Learning
Explore learning methods, model architectures, datasets, and practical applications.
Explore articles
Browse subtopics: AI Inference
Articles that also belong to these categories. Counts cover all of Machine Learning.
All articles (862)Deep Learning (187)Natural Language Processing (92)Statistics (90)Training & Optimization (70)Data & Datasets (65)Neural Networks (58)Reinforcement Learning (58)Model Evaluation (55)Artificial Intelligence (54)Large Language Models (50)Mathematics (48)Computer Vision (42)AI Ethics (35)AI Infrastructure (29)AI Safety (26)Open Source AI (25)Data Science (24)AI Benchmarks (22)Developer Tools (20)Algorithms (19)AI Hardware (17)AI Tools & Products (17)Google (16)Information Retrieval (16)Generative AI (14)People (14)Model Architecture (13)AI Agents (12)Interpretability (12)Robotics (12)AI Companies (11)AI Inference (11)Transformer Models (11)MLOps (10)AI Models (9)AI Research (8)Computer Science (8)AI Code Generation (7)Multimodal AI (7)Speech & Audio AI (7)Chinese AI (6)AI Policy & Regulation (5)Meta AI (5)Programming Languages (5)AI History (4)AI for Science (4)Prompt Engineering (4)AI Alignment (3)AI Events (3)Reasoning Models (3)Embodied AI (2)Software Development (2)World Models (2)2025 in artificial intelligence (1)Anthropic (1)Diffusion Models (1)Drug Discovery (1)Education AI (1)Enterprise AI (1)Healthcare AI (1)Image Generation (1)NVIDIA (1)Small Language Models (1)
Showing 1-11 of 11 articles
Jev (AI model)
Jev is an AI model released in waitlisted early access on 15 September 2026, and opened to all developers on 20 September, by TypeSafe AI, a San Francisco startup founded in 2024 by former OpenAI researcher…
KV Cache
KV cache, short for key-value cache, is transient model state used during Transformer generation.
Knowledge Distillation
Knowledge distillation is a training method in which a student model learns from signals produced by a teacher model.
NOSA (Native and Offloadable Sparse Attention)
NOSA (Native and Offloadable Sparse Attention) is a trainable sparse attention mechanism designed so that most of a language model's KV cache can live in CPU memory during decoding without the CPU-to-GPU…
On-device AI
On-device AI is the practice of running machine learning models on the phone, laptop, watch, or embedded board a person is actually using, instead of sending the input to a remote data center.
Pruning
Pruning is a family of techniques used in machine learning and artificial intelligence to remove parts of a model or search space that are estimated to be unnecessary for accuracy or optimality.
Quantization
Quantization is the representation of values from a large or continuous set by values from a smaller, usually finite set.
Speculative Decoding
Speculative decoding is a lossless inference acceleration technique for autoregressive transformer models in which a small, fast draft model proposes several future tokens at once and the larger target model…
Test-Time Training (TTT)
Test-Time Training (TTT) is a family of machine learning techniques in which a model updates a subset of its own parameters at inference time
Zhijian Liu
Zhijian Liu is a computer scientist who works on efficient machine learning. He is an assistant professor at the University of California, San Diego, where he directs Z Lab, and a co-founder of Inco AI