Revision History
Weight Decay · 7 revisions
Sizes are character counts of the article source. The signed number is the change from the previous revision.
Recent edit summaries
Detailed summaries recorded by editors. Generic maintenance summaries are omitted here; every recorded revision remains below. Dates describe the edit, not necessarily the event it covers.
- Correction: Corrected the Adam-with-L2 update equation (it showed the decoupled form), the description of Hanson and Pratt's 1988 paper, PaLM's weight decay (dynamic lr^2, not zero), invented Claude and Gemini hyperparameter rows, the misstated Wang and Aitchison scaling result, and misattributed authors for five cited papers (low-rank bias, why-weight-decay, stable weight decay, p-norm weight decay) and the batch-norm effective-learning-rate finding (plus 23 minor fixes)
Version 7 · Nov 1, 2026, 11:24 AM
- Improve internal links (2026-10-13)
Version 6 · Oct 13, 2026, 10:17 AM
- Added 6 contextual internal links
Version 5 · Jul 23, 2026, 03:28 PM
- Render formulas with LaTeX math notation
Version 4 · Jul 11, 2026, 06:32 PM