FP4 (4-bit floating point)
FP4 (4-bit floating point) is a numerical format that stores a real number in just 4 bits, the smallest floating-point type in mainstream use for deep learning.
AI Hardware
Explore AI Hardware through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Training & Optimization
Articles that also belong to these categories. Counts cover all of AI Hardware.
All articles (308)AI Compute (179)AI Infrastructure (110)AI Companies (76)NVIDIA (68)Data Centers (40)AI Inference (35)Chinese AI (31)Google (22)Machine Learning (19)AI Policy & Regulation (17)Robotics (13)Computer Science (10)Artificial Intelligence (8)Autonomous Vehicles (7)Deep Learning (6)Developer Tools (6)Meta AI (5)Open Source AI (5)Training & Optimization (5)AI Benchmarks (4)Large Language Models (4)Microsoft (4)People (4)AI Agents (3)AI Tools & Products (3)Algorithms (3)Computer Vision (3)Edge computing (3)Neural Networks (3)AI Models (2)AI for Science (2)Consumer AI Devices (2)Embodied AI (2)Healthcare AI (2)OpenAI (2)Physical AI (2)AI Energy (1)AI Events (1)AI Safety (1)Enterprise AI (1)Finance AI (1)Generative AI (1)Google DeepMind (1)Image Generation (1)MLOps (1)Mathematics (1)Model Evaluation (1)Reinforcement Learning (1)Robot Hardware (1)Robotics Companies (1)Small Language Models (1)Speech & Audio AI (1)Transformer Models (1)Video Generation (1)
Showing 1-5 of 5 articles
FP8
FP8 is a family of 8-bit floating-point number formats used to accelerate deep learning training and inference, built around two encodings, E4M3 (4 exponent bits, 3 mantissa bits) and E5M2 (5 exponent bits, 2…
MXFP4
MXFP4 (Microscaling FP4) is a 4-bit block-scaled number format for quantization in machine learning, defined in the Open Compute Project (OCP) Microscaling Formats (MX) Specification v1.0 of September 2023.
NCCL (NVIDIA Collective Communications Library)
NCCL, the NVIDIA Collective Communications Library, is a library of topology-aware communication primitives for NVIDIA GPU systems.
Tensor Core
A Tensor Core is a specialized execution unit inside NVIDIA GPUs that computes a small matrix multiplication and accumulation, D = A x B + C