Revision History
Rotary Position Embedding · 13 revisions
Sizes are character counts of the article source. The signed number is the change from the previous revision.
Recent edit summaries
Detailed summaries recorded by editors. Generic maintenance summaries are omitted here; every recorded revision remains below. Dates describe the edit, not necessarily the event it covers.
- Correction: GPT-NeoX-20B applies RoPE to 25% of dimensions (not the full head); Phi-2 uses partial RoPE (40%); Kexue.fm origin dated Feb/Mar 2021; Dynamic NTK credited to Reddit user emozilla; removed undisclosed Mistral Large (Feb 2024) row and unsourced figures; long-term decay caveats. Update: adoption table rechecked against papers/configs and extended to 2026, Llama 3.1 scaling, partial RoPE, M-RoPE, decoupled RoPE, interleaved NoPE layers.
Version 13 · Oct 31, 2026, 03:24 AM
- Improve internal links (2026-10-13)
Version 12 · Oct 13, 2026, 10:07 AM
- Added 6 contextual internal links
Version 11 · Jul 23, 2026, 03:04 PM
- Render formulas with LaTeX math notation
Version 10 · Jul 11, 2026, 07:13 PM