FP4 (4-bit floating point)
FP4 (4-bit floating point) is a numerical format that stores a real number in just 4 bits, the smallest floating-point type in mainstream use for deep learning.
Training & Optimization
Explore Training & Optimization through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: AI Compute
Articles that also belong to these categories. Counts cover all of Training & Optimization.
All articles (153)Machine Learning (71)Deep Learning (41)Large Language Models (18)AI Infrastructure (11)Developer Tools (11)AI Inference (10)Open Source AI (10)Mathematics (9)Reinforcement Learning (9)AI Alignment (7)Natural Language Processing (7)MLOps (6)Statistics (6)AI Hardware (5)NVIDIA (5)AI Compute (4)Data & Datasets (4)Artificial Intelligence (3)Computer Vision (3)Meta AI (3)Reasoning Models (3)AI Research (2)Algorithms (2)Chinese AI (2)Generative AI (2)Model Evaluation (2)Robotics (2)Transformer Models (2)AI Agents (1)AI Code Generation (1)AI Models (1)AI Tools & Products (1)Enterprise AI (1)Google (1)Google DeepMind (1)Humanoid Robots (1)Microsoft (1)Mixture of Experts (1)Model Architecture (1)Neural Networks (1)OpenAI (1)Small Language Models (1)World Models (1)
Showing 1-4 of 4 articles
FP8
FP8 is a family of 8-bit floating-point number formats used to accelerate deep learning training and inference, built around two encodings, E4M3 (4 exponent bits, 3 mantissa bits) and E5M2 (5 exponent bits, 2…
Tensor Core
A Tensor Core is a specialized execution unit inside NVIDIA GPUs that computes a small matrix multiplication and accumulation, D = A x B + C
Training compute
Training compute is the total number of floating-point operations (FLOP) performed to train a machine learning model, normally counted over the forward and backward passes of the final training run.