Revision History
GELU (Gaussian Error Linear Unit) · 8 revisions
Sizes are character counts of the article source. The signed number is the change from the previous revision.
Recent edit summaries
Detailed summaries recorded by editors. Generic maintenance summaries are omitted here; every recorded revision remains below. Dates describe the edit, not necessarily the event it covers.
- Correction: Corrected the paper's experiment details (architectures, margins, largest gain on CIFAR-100 not TIMIT), the v5 revision date (2023, not 2020), the location of the derivative's maximum, the SiLU/Swish naming history, and which GELU form BERT, RoBERTa, T5 v1.1 and Whisper reference code use (original BERT used exact erf), and replaced an unsupported Hugging Face reproducibility anecdote (plus 12 minor fixes)
Version 8 · Nov 5, 2026, 03:06 AM
- Update: added a video.
Version 7 · Nov 1, 2026, 08:17 AM
- Improve internal links (2026-10-13)
Version 6 · Oct 13, 2026, 10:19 AM
- Added 6 contextual internal links
Version 5 · Jul 23, 2026, 03:29 PM