GPT: Difference between revisions

← Older edit

GPT (view source)

Revision as of 18:00, 15 July 2023

845 bytes added , 15 July 2023

→‎GPT API

Startledcat

1,151

edits

@@ Line 1: / Line 1: @@
 {{Needs Expansion}}
-[[GPT-1]]
+==GPT API==
+'''[[GPT API|Documentation and Guide for GPT API]]'''
-[[GPT-2]]
-[[GPT-3]]
-[[ChatGPT]]
-[[GPT-3.5]]
 ==Main GPT Models==
-{| class="wikitable"
+{| class="wikitable sortable"
 |-
 ! rowspan="2" | Model
+! rowspan="2" | Release Date
 ! rowspan="2" | Parameters
-! colspan="5" | Training Data
 ! colspan="3" | Context Window
+! colspan="2" | Training Data
+! rowspan="2" | Open Source
+! rowspan="2" | Paper
 |-
-! hello
-! hello
-! hello
-! hello
-! hello
 ! Tokens
 ! Words
 ! Equivalent
+! Amount
+! Dataset
+|-
+| '''[[GPT-1]]''' || June 11, 2018 ||117 Million || 512 || 358 || <1 page || 4.5 GB || [[BookCorpus]] || Yes || [[Improving Language Understanding by Generative Pre-Training]]
 |-
-| [[GPT-1]] || 117 Million ||  ||  ||  ||  ||  || 512 || 358 ||
+| '''[[GPT-2]]''' ||  February 14, 2019 || 1.5 Billion || 1024 || 716 || 1.5 pages || 40 GB || [[WebText]] || Yes || [[Language Models are Unsupervised Multitask Learners]]
 |-
-| [[GPT-2]] || 1.5 Billion ||  ||  ||  ||  ||  || 1024 || 716 ||
+| '''[[GPT-3]]''' || June 11, 2020 || 175 Billion || 2,048 || 1,433 || 3 pages || 570 GB || [[Common Crawl]], [[WebText2]], [[Books1]], [[Books2]], [[Wikipedia]] || No || [[Language Models are Few-Shot Learners]]
 |-
-| [[GPT-3]] || 175 Billion ||  ||  ||  ||  ||  || 2,048 || 1,433 ||
+| '''[[GPT-3.5]]''' || March 15, 2022 || 175 Billion  || 4,000 || 2,800 || 6 pages || 570 GB || [[Common Crawl]], [[WebText2]], [[Books1]], [[Books2]], [[Wikipedia]] || No ||
 |-
-| [[GPT-3.5]] || xxx ||  ||  ||  ||  ||  || 4,000 || 2,800 ||
+| '''[[ChatGPT]]''' || November 30, 2022 || 175 Billion || 4,096 || 2,867 || 6 pages || 570 GB || [[Common Crawl]], [[WebText2]], [[Books1]], [[Books2]], [[Wikipedia]] || No ||
 |-
-| [[ChatGPT]] || xxx ||  ||  ||  ||  ||  || 4,096 || 2,867 ||
+| '''[[GPT-4]]'''<br>(v1) || ???? || 100 Trillion?? || 8,000 || 5,600 || 12 pages ||  || || No ||
 |-
-| [[GPT-4]] || ??? ||
+| '''[[GPT-4]]'''<br>(v2) || ???? || 100 Trillion?? || 32,000 || 22,400 || 50 pages ||  || || No ||
 |-
 |}