Revision History
Switch Transformer · 10 revisions
Sizes are character counts of the article source. The signed number is the change from the previous revision.
Recent edit summaries
Detailed summaries recorded by editors. Generic maintenance summaries are omitted here; every recorded revision remains below. Dates describe the edit, not necessarily the event it covers.
- Correction: Corrected an invented 4x to 9x Switch-XXL speed-up and an unsupported 4.4x Switch-Large speed-up, reversed a wrong claim that the stability techniques made Switch-XXL trainable (the paper says they were not sufficient), fixed the distillation teacher size (3.8B, not 7.4B, for 30 percent at 95 percent compression), and removed the claim that Switch-C was the first trillion-parameter model disclosed (GShard reported one in 2020) (plus 19 minor fixes)
Version 10 · Nov 4, 2026, 09:23 PM
- Update: added a video.
Version 9 · Nov 1, 2026, 08:12 AM
- Improve internal links (2026-10-13)
Version 7 · Oct 13, 2026, 10:19 AM
- Added 6 contextual internal links
Version 6 · Jul 23, 2026, 03:29 PM
- Render formulas with LaTeX math notation
Version 5 · Jul 11, 2026, 11:41 PM