Interface administrators, Administrators (Semantic MediaWiki), Curators (Semantic MediaWiki), Editors (Semantic MediaWiki), Suppressors, Administrators
7,785
edits
GPT: Difference between revisions
no edit summary
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
{{Needs Expansion}} | {{Needs Expansion}} | ||
==Main GPT Models== | ==Main GPT Models== | ||
{| class="wikitable" | {| class="wikitable" | ||
| Line 15: | Line 5: | ||
! rowspan="2" | Model | ! rowspan="2" | Model | ||
! rowspan="2" | Parameters | ! rowspan="2" | Parameters | ||
! colspan="3" | Context Window | |||
! colspan="5" | Training Data | ! colspan="5" | Training Data | ||
|- | |- | ||
! Tokens | |||
! Words | |||
! Equivalent | |||
! hello | ! hello | ||
! hello | ! hello | ||
| Line 23: | Line 16: | ||
! hello | ! hello | ||
! hello | ! hello | ||
|- | |- | ||
| [[GPT-1]] || 117 Million || | | [[GPT-1]] || 117 Million || 512 || 358 || || || || || | ||
|- | |- | ||
| [[GPT-2]] || 1.5 Billion || || || || || || 1024 || 716 || | | [[GPT-2]] || 1.5 Billion || || || || || || 1024 || 716 || | ||
| Line 37: | Line 27: | ||
| [[ChatGPT]] || xxx || || || || || || 4,096 || 2,867 || | | [[ChatGPT]] || xxx || || || || || || 4,096 || 2,867 || | ||
|- | |- | ||
| [[GPT-4]] || | | [[GPT-4]] || xxx || || || || || || 4,096 || 2,867 || | ||
|- | |- | ||
|} | |} | ||