Create Chat Conversation Request
Large Language Models
Create Chat Conversation Request
POST
Create Chat Conversation Request
Generate a model response based on the specified chat conversation
Request Headers
Enum value:
application/jsonBearer authentication format: Bearer {{API Key}}.
Request Body
The name of the model to use.
A list of messages that make up the current conversation.
The maximum number of tokens to generate in the completion.If your prompt (previous messages) plus max_tokens exceeds the model’s context length, the behavior depends on context_length_exceeded_behavior. By default, max_tokens will be reduced to fit within the context window instead of returning an error.
Whether to return partial progress as a stream. If set, tokens will be sent as data-only server-sent events (SSE) as they become available, and the stream will terminate with a
data: [DONE] message.Options for the streaming response. Set this only when stream is set to true.
The number of completions to generate for each prompt.Note: Because this parameter generates many completions, it may quickly consume your token quota. Use it with caution, and make sure you have reasonable settings for max_tokens and stop.Required range:
1 < x < 128If specified, our system will make a best effort to sample deterministically, so repeated requests with the same seed and parameters should return the same result.
Positive values penalize new tokens based on their existing frequency in the text, reducing the likelihood that the model will repeat the same line verbatim.If the goal is only to slightly reduce repetitive samples, reasonable values are between 0.1 and 1. If the goal is to strongly suppress repetition, the coefficient can be increased to 2, but this may significantly degrade sample quality. Negative values can be used to increase the likelihood of repetition.See also presence_penalty, which penalizes tokens that have appeared at least once at a fixed rate.Required range:
-2 < x < 2Positive values penalize new tokens based on whether they appear in the text, increasing the likelihood that the model will talk about new topics.If the goal is only to slightly reduce repetitive samples, reasonable values are between 0.1 and 1. If the goal is to strongly suppress repetition, the coefficient can be increased to 2, but this may significantly degrade sample quality. Negative values can be used to increase the likelihood of repetition.See also
frequency_penalty, which penalizes tokens at an increasing rate based on how frequently they appear.Required range: -2 < x < 2Applies a penalty to repeated tokens to discourage or encourage repetition. A value of 1.0 means no penalty, allowing free repetition. Values above 1.0 penalize repetition, reducing the likelihood of repeated tokens. Values between 0.0 and 1.0 reward repetition, increasing the chance of repeated tokens. For a good balance, a value of 1.2 is usually recommended. Note that the penalty applies to both the generated output and the prompt in decoder-only models.Required range:
0 < x < 2Up to 4 sequences where the API will stop generating further tokens. The returned text will contain the stop sequence.
The sampling temperature to use, between 0 and 2. Higher values such as 0.8 make the output more random, while lower values such as 0.2 make it more focused and deterministic.We generally recommend changing this or
top_p, but not both.Required range: 0 < x < 2An alternative to sampling with temperature, called nucleus sampling, where the model considers token results with top_p probability mass. Thus, 0.1 means only the tokens comprising the top 10% probability mass are considered. We generally recommend changing this or temperature, but not both.Required range:
0 < x <= 1Top-k sampling is another sampling method where the k most likely next tokens are filtered, and the probability mass is redistributed only among these k next tokens. The value of k controls the number of candidate next tokens at each step during text generation.Required range:
1 < x < 128Represents the minimum probability for tokens to be considered, relative to the probability of the most likely token.Required range:
0 <= x <= 1Modifies the likelihood of specified tokens appearing in the completion.Accepts a JSON object that maps tokens to associated bias values between -100 and 100.
Mathematically, the bias is added to the logits generated by the model before sampling. The exact effect will vary by model.For example, setting
"logit_bias":{"1024": 6} will increase the likelihood of tokens with token ID 1024.Whether to return the log probabilities of output tokens. If true, the log probability of each output token in the message content is returned.
An integer between 0 and 20 specifying the number of most likely tokens to return at each token position, each with an associated log probability. If this parameter is used,
logprobs must be set to true.Required range: 0 <= x <= 20A list of tools the model can call. Currently, only functions are supported as tools. Use this to provide a list of functions for which the model can generate JSON inputs.Learn more about function calling in the Function Calling Guide.
Allows forcing the model to generate a specific output format.Set to
{ "type": "json_schema", "json_schema": {...} } to enable structured outputs and ensure the model will match the JSON schema you provide.Set to { "type": "json_object" } to enable the legacy JSON mode, ensuring that messages generated by the model are valid JSON. For models that support it, json_schema is recommended.Whether to separate reasoning from “content” into the “reasoning_content” field.Supported models:
deepseek/deepseek-r1-turbo
Controls switching between thinking and non-thinking modes.Supported models:
zai-org/glm-4.5
Response Information
The list of chat completion choices.
The Unix time when the response was generated, in seconds.
The unique identifier of the response.
The model used for the chat completion.
The object type, always
chat.completion.Usage statistics.For streaming responses, the usage field is included in the last response chunk returned.