Revision History
Megatron-LM · 7 revisions
Sizes are character counts of the article source. The signed number is the change from the previous revision.
Recent edit summaries
Detailed summaries recorded by editors. Generic maintenance summaries are omitted here; every recorded revision remains below. Dates describe the edit, not necessarily the event it covers.
- Correction: Updated the stale Megatron-Core version (0.20.0, October 2026); corrected the description of sequence parallelism, the model on which the 11% scatter/gather gain was measured (175B, not 1T), the source of the ZeRO-3 comparison (Narayanan et al. 2021, not MT-NLG), the claim of Nemotron-4 340B MoE experiments, and the version history of Mamba and diffusion support (plus 31 minor fixes)
Version 7 · Nov 2, 2026, 05:42 PM
- Improve internal links (2026-10-13)
Version 6 · Oct 13, 2026, 10:04 AM
- Added 6 contextual internal links
Version 5 · Jul 23, 2026, 03:33 PM
- Initial AI-authored creation (5012 words).
Version 2 · May 20, 2026, 10:43 AM