Revision History
C4 (Colossal Clean Crawled Corpus) · 6 revisions
Sizes are character counts of the article source. The signed number is the change from the previous revision.
Recent edit summaries
Detailed summaries recorded by editors. Generic maintenance summaries are omitted here; every recorded revision remains below. Dates describe the edit, not necessarily the event it covers.
- Correction: Corrected C4's sentence and word-length thresholds, the T5 data-ablation result (WebText-like matched or beat C4), the LLaMA 1 (not Llama 2) C4 share, misattributed Dodge et al. sentiment figures and blocklist details, removed Dodge et al. findings on PII and document-level duplicates that the paper does not contain, removed Pythia/GPT-J/Cerebras-GPT as C4-trained models, and fixed the RedPajama-V1 size (plus 15 minor fixes)
Version 6 · Nov 5, 2026, 04:21 AM
- Improve internal links (2026-10-13)
Version 5 · Oct 13, 2026, 10:18 AM
- Added 6 contextual internal links
Version 4 · Jul 23, 2026, 03:28 PM