GPT API: Difference between revisions

From AI Wiki
Line 36: Line 36:
===messages===
===messages===
====role====
====role====
*'''[[system]]''': This role is used to provide high-level instructions that guide the behavior of the model throughout the conversation. It sets the context and tone of the interaction. For example, a system message might instruct the model to "Speak like Shakespeare," thereby guiding the model to generate responses in a Shakespearean style.
=====system=====
This role is used to provide high-level instructions that guide the behavior of the model throughout the conversation. It sets the context and tone of the interaction. For example, a system message might instruct the model to "Speak like Shakespeare," thereby guiding the model to generate responses in a Shakespearean style.


*'''[[user]]''': Messages with this role are input from the user. They are the questions, comments, or prompts that the user provides to the AI model. The user role instructs the model on what the user wants or expects in response.
=====user=====
Messages with this role are input from the user. They are the questions, comments, or prompts that the user provides to the AI model. The user role instructs the model on what the user wants or expects in response.


*'''[[assistant]]''': This role represents the output from the AI model. These messages are the responses generated by the AI in reply to the user's input or following the instructions provided by the system.
=====assistant=====
This role represents the output from the AI model. These messages are the responses generated by the AI in reply to the user's input or following the instructions provided by the system.


*'''[[function]]''':
=====function=====


===functions===
===functions===

Revision as of 19:18, 15 July 2023

Documentation and Guide for OpenAI's GPT API.

Request Fields

model

 model: "gpt-3.5-turbo"

The value for the model field is a string that contains the name of the GPT model you want to use.

The value for the model field can have up to 3 components:

 model: "gpt-3.5-turbo-16k-0613"

In the example above, the gpt-3.5-turbo is the name of the model. The 16k is the context length in tokens. The 0613 is the date when the model snapshot is taken, which is June 13th.

Model Names and Context Window in # of Tokens

Model Context Window
gpt-3.5-turbo 4,096 tokens
gpt-3.5-turbo-16k 16,384 tokens
gpt-4 8,192 tokens
gpt-4-32k 32,768 tokens
  • Note that every 100 tokens are about 75 words.

messages

role

system

This role is used to provide high-level instructions that guide the behavior of the model throughout the conversation. It sets the context and tone of the interaction. For example, a system message might instruct the model to "Speak like Shakespeare," thereby guiding the model to generate responses in a Shakespearean style.

user

Messages with this role are input from the user. They are the questions, comments, or prompts that the user provides to the AI model. The user role instructs the model on what the user wants or expects in response.

assistant

This role represents the output from the AI model. These messages are the responses generated by the AI in reply to the user's input or following the instructions provided by the system.

function

functions

function_call

stream

Response Fields

model