Revision History
Activation Function · 12 revisions
Sizes are character counts of the article source. The signed number is the change from the previous revision.
Recent edit summaries
Detailed summaries recorded by editors. Generic maintenance summaries are omitted here; every recorded revision remains below. Dates describe the edit, not necessarily the event it covers.
- Correction: Corrected the claims that Nair and Hinton introduced ReLU, that GPT-2/GPT-3 inherited GELU from BERT (the original GPT used it first), and that LLaMA introduced SwiGLU (PaLM used it first) (plus 8 minor fixes)
Version 12 · Nov 1, 2026, 11:22 AM
- Update: added a video.
Version 11 · Nov 1, 2026, 08:12 AM
- Improve internal links (2026-10-13)
Version 9 · Oct 13, 2026, 10:01 AM
- Added 6 contextual internal links
Version 8 · Jul 23, 2026, 03:00 PM
- Render formulas with LaTeX math notation
Version 7 · Jul 11, 2026, 06:32 PM