Create Chat Completion
LLM
Create Chat Completion
POST
Create Chat Completion
Generate a model response based on the specified chat conversation.
Request Headers
Enum:
application/jsonBearer authentication format: Bearer {{API Key}}.
Request Body
The name of the model to use.
A list of messages comprising the current conversation.
The maximum number of tokens to generate in the completion.If the number of tokens in your prompt (previous messages) plus max_tokens exceeds the model’s context length, the behavior depends on context_length_exceeded_behavior. By default, max_tokens will be reduced to fit the context window rather than returning an error.
Whether to stream partial progress. If set, tokens will be sent as data-only server-sent events (SSE) as they become available, and the stream will be terminated with a
data: [DONE] message.Options for streaming responses. Only set this when stream is set to true.
The number of completions to generate for each prompt.Note: Because this parameter generates many completions, it can quickly consume your token quota. Use carefully and ensure you have reasonable settings for max_tokens and stop.Required range:
1 < x < 128If specified, our system will make a best effort to sample deterministically, such that repeated requests with the same seed and parameters should return the same result.
Positive values penalize new tokens based on their existing frequency in the text, decreasing the model’s likelihood of repeating the same line verbatim.If the goal is only to slightly reduce repetitive samples, reasonable values are between 0.1 and 1. If the goal is to strongly suppress repetition, the coefficient can be increased to 2, but this may noticeably degrade sample quality. Negative values can be used to increase the likelihood of repetition.See also presence_penalty, which penalizes tokens that have appeared at least once at a fixed rate.Required range:
-2 < x < 2Positive values penalize new tokens based on whether they appear in the text so far, increasing the model’s likelihood of talking about new topics.If the goal is only to slightly reduce repetitive samples, reasonable values are between 0.1 and 1. If the goal is to strongly suppress repetition, the coefficient can be increased to 2, but this may noticeably degrade sample quality. Negative values can be used to increase the likelihood of repetition.See also
frequency_penalty, which penalizes tokens at an increasing rate based on how often they appear.Required range: -2 < x < 2Applies a penalty to repeated tokens to discourage or encourage repetition. A value of 1.0 means no penalty, allowing free repetition. Values above 1.0 penalize repetition, reducing the likelihood of repeated tokens. Values between 0.0 and 1.0 reward repetition, increasing the chance of repeated tokens. A value of 1.2 is generally recommended for a good balance. Note that the penalty applies to both the generated output and the prompt in decoder-only models.Required range:
0 < x < 2Up to 4 sequences where the API will stop generating further tokens. The returned text will include the stop sequence.
The sampling temperature to use, between 0 and 2. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic.We generally recommend altering this or
top_p, but not both.Required range: 0 < x < 2An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. We generally recommend altering this or temperature, but not both.Required range:
0 < x <= 1Top-k sampling is another sampling method where the k most likely next tokens are filtered and the probability mass is redistributed among only those k next tokens. The value of k controls the number of candidates for the next token at each step during text generation.Required range:
1 < x < 128Represents the minimum probability for a token to be considered, relative to the probability of the most likely token.Required range:
0 <= x <= 1Modify the likelihood of specified tokens appearing in the completion.Accepts a JSON object that maps tokens to an associated bias value from -100 to 100.
Mathematically, the bias is added to the logits generated by the model prior to sampling. The exact effect will vary per model.For example, setting
"logit_bias":{"1024": 6} will increase the likelihood of the token with ID 1024.Whether to return log probabilities of the output tokens. If true, returns the log probabilities of each output token in the message content.
An integer between 0 and 20 specifying the number of most likely tokens to return at each token position, each with an associated log probability.
logprobs must be set to true if this parameter is used.Required range: 0 <= x <= 20A list of tools the model may call. Currently, only functions are supported as tools. Use this to provide a list of functions the model may generate JSON inputs for.Learn more about function calling in the Function Calling Guide.
Allows forcing the model to produce a specific output format.Set to
{ "type": "json_schema", "json_schema": {...} } to enable Structured Outputs, which ensures the model will match your supplied JSON schema.Set to { "type": "json_object" } to enable the legacy JSON mode, which ensures the model generates messages that are valid JSON. For models that support it, json_schema is recommended.Whether to separate reasoning from “content” into the “reasoning_content” field.Supported models:
deepseek/deepseek-r1-turbo
Controls switching between thinking and non-thinking modes.Supported models:
zai-org/glm-4.5
Response
A list of chat completion choices.
The Unix timestamp (in seconds) of when the response was generated.
A unique identifier for the response.
The model used for the chat completion.
The object type, always
chat.completion.Usage statistics.For streaming responses, the usage field is included in the last response chunk returned.