FP4 (4-bit floating point)
FP4 (4-bit floating point) is a numerical format that stores a real number in just 4 bits, the smallest floating-point type in mainstream use for deep learning.
AI Compute
Explore AI Compute through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Training & Optimization
Articles that also belong to these categories. Counts cover all of AI Compute.
All articles (232)AI Hardware (175)AI Infrastructure (126)Data Centers (57)AI Companies (51)NVIDIA (51)AI Inference (21)Chinese AI (15)Google (13)AI Policy & Regulation (11)Meta AI (9)Machine Learning (8)OpenAI (7)Artificial Intelligence (6)Microsoft (5)Deep Learning (4)Finance AI (4)AI Energy (3)Training & Optimization (3)AI Benchmarks (2)Anthropic (2)Model Evaluation (2)Open Source AI (2)AI Agents (1)AI Research (1)AI Safety (1)AI Tools & Products (1)Edge computing (1)Enterprise AI (1)Venture Capital (1)
Showing 1-3 of 3 articles
Tensor Core
A Tensor Core is a specialized execution unit inside NVIDIA GPUs that computes a small matrix multiplication and accumulation, D = A x B + C
Training compute
Training compute is the total number of floating-point operations (FLOP) performed to train a machine learning model, normally counted over the forward and backward passes of the final training run.