OpenAI: GPT-3.5 Turbo (batch)

OpenAI

openai/gpt-3.5-turbo

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. Training data up to Sep 2021.

Context

16K

Input /1M

$0.25

Output /1M

$0.75

Latency (TTFT)

471ms

Pricing

Per 1M tokens, in USD

Input$0.25

Output$0.75

Specs

text intext outModerated

TokenizerGPT

Max output tokens4,096

Supported parameters

frequency_penaltylogit_biaslogprobsmax_tokenspresence_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_logprobstop_p

Where it ranks on price

Against 157 routable models

Input$0.25

Cheaper than 70% of routable models

Output$0.75

Cheaper than 81% of routable models

Benchmarks

No third-party benchmark data available for this model yet.

Call this model

Swap in your Mizan key — the request/response bodies are OpenAI chat-completion shaped.

cURL

curl https://api.app-mizan.com/v1/chat/completions \
  -H "Authorization: Bearer mizan_rt_..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openai/gpt-3.5-turbo",
    "messages": [{ "role": "user", "content": "Say hi in five words." }]
  }'

Models

OpenAI: GPT-3.5 Turbo (batch)

OpenAI

openai/gpt-3.5-turbo

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. Training data up to Sep 2021.

Context

16K

Input /1M

$0.25

Output /1M

$0.75

Latency (TTFT)

471ms

Pricing

Per 1M tokens, in USD

Input$0.25

Output$0.75

Specs

text intext outModerated

TokenizerGPT

Max output tokens4,096

Supported parameters

frequency_penaltylogit_biaslogprobsmax_tokenspresence_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_logprobstop_p

Where it ranks on price

Against 157 routable models

Input$0.25

Cheaper than 70% of routable models

Output$0.75

Cheaper than 81% of routable models

Benchmarks

No third-party benchmark data available for this model yet.

Call this model

Swap in your Mizan key — the request/response bodies are OpenAI chat-completion shaped.

cURL

curl https://api.app-mizan.com/v1/chat/completions \
  -H "Authorization: Bearer mizan_rt_..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openai/gpt-3.5-turbo",
    "messages": [{ "role": "user", "content": "Say hi in five words." }]
  }'