FP4 (4-bit floating point)
FP4 (4-bit floating point) is a numerical format that stores a real number in just 4 bits, the smallest floating-point type in mainstream use for deep learning.
AI Hardware
Explore AI Hardware through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Training & Optimization
Articles that also belong to these categories. Counts cover all of AI Hardware.
All articles (355)AI Infrastructure (98)AI Companies (85)NVIDIA (61)Robotics (44)Chinese AI (37)Data Centers (36)AI Inference (30)Google (24)AI Tools & Products (18)AI Policy & Regulation (17)Machine Learning (17)Artificial Intelligence (10)Computer Science (10)Meta AI (10)Open Source AI (9)Autonomous Vehicles (7)Deep Learning (6)Developer Tools (5)Embodied AI (5)Humanoid Robots (5)Microsoft (5)Computer Vision (4)Large Language Models (4)Robotics Companies (4)AI Benchmarks (3)AI Models (3)Algorithms (3)Neural Networks (3)OpenAI (3)People (3)Training & Optimization (3)AI History (2)AI for Science (2)Edge computing (2)Google DeepMind (2)Healthcare AI (2)Multimodal AI (2)Reinforcement Learning (2)AI Energy (1)AI Ethics (1)Enterprise AI (1)Finance AI (1)Generative AI (1)Image Generation (1)MLOps (1)Mathematics (1)Physical AI (1)Robot Hardware (1)Small Language Models (1)Transformer Models (1)Video Generation (1)
Showing 1-3 of 3 articles
NCCL (NVIDIA Collective Communications Library)
NCCL, the NVIDIA Collective Communications Library, is a library of topology-aware communication primitives for NVIDIA GPU systems.
Tensor Core
A Tensor Core is a specialized execution unit inside NVIDIA GPUs that computes a small matrix multiplication and accumulation, D = A x B + C