Megatron-LM
Megatron-LM is NVIDIA's open-source framework for training very large transformer language models across GPU clusters
NVIDIA
Explore NVIDIA through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Training & Optimization
Articles that also belong to these categories. Counts cover all of NVIDIA.
All articles (134)AI Hardware (61)AI Infrastructure (35)Open Source AI (28)Developer Tools (23)Robotics (19)AI Models (16)Data Centers (15)Large Language Models (12)AI Inference (10)AI Agents (7)Embodied AI (7)AI Tools & Products (5)Generative AI (5)Training & Optimization (4)AI Benchmarks (3)AI Companies (3)Autonomous Vehicles (3)Chinese AI (3)Data & Datasets (3)Enterprise AI (3)Reasoning Models (3)Reinforcement Learning (3)Speech & Audio AI (3)AI Safety (2)Data Science (2)Deep Learning (2)Diffusion Models (2)Hardware (2)Humanoid Robots (2)MLOps (2)Mixture of Experts (2)Multimodal AI (2)People (2)Physical AI (2)AI Events (1)AI Research (1)AI in Cybersecurity (1)AI in Gaming (1)Computer Vision (1)Edge computing (1)Healthcare AI (1)Image Generation (1)Machine Learning (1)Model Evaluation (1)Natural Language Processing (1)Quantum Computing (1)Small Language Models (1)Venture Capital (1)Video Generation (1)World Models (1)
Showing 1-4 of 4 articles
Minitron
Minitron is a family of compact language models from NVIDIA, together with the model-compression method used to build them: take one large, already pretrained large language model and shrink it into smaller…
NCCL (NVIDIA Collective Communications Library)
NCCL, the NVIDIA Collective Communications Library, is a library of topology-aware communication primitives for NVIDIA GPU systems.
Tensor Core
A Tensor Core is a specialized execution unit inside NVIDIA GPUs that computes a small matrix multiplication and accumulation, D = A x B + C