Jump to content

GPT: Difference between revisions

4 bytes removed ,  3 March 2023
no edit summary
No edit summary
No edit summary
Line 19: Line 19:
| '''[[GPT-2]]''' ||  February 14, 2019 || 1.5 Billion || 1024 || 716 ||  || 40TB || [[WebText]]
| '''[[GPT-2]]''' ||  February 14, 2019 || 1.5 Billion || 1024 || 716 ||  || 40TB || [[WebText]]
|-
|-
| '''[[GPT-3]]''' || June 11, 2020 || 175 Billion || 2,048 || 1,433 ||  ||  ||  ||  || [[Common Crawl]], [[WebText2]], [[Books1]], [[Books2]], [[Wikipedia]]
| '''[[GPT-3]]''' || June 11, 2020 || 175 Billion || 2,048 || 1,433 ||  ||  ||  || [[Common Crawl]], [[WebText2]], [[Books1]], [[Books2]], [[Wikipedia]]
|-
|-
| '''[[GPT-3.5]]''' || January 2022 || 1.3 Bilion, 6 Billion, 175 Billion  || 4,000 || 2,800 ||  ||  ||  ||  ||  
| '''[[GPT-3.5]]''' || January 2022 || 1.3 Bilion, 6 Billion, 175 Billion  || 4,000 || 2,800 ||  ||  ||  ||  ||