Rate limits

Defaults: per API key 300 requests and 1,000,000 tokens per minute; per organisation 600 requests and 2,000,000 tokens per minute. Tokens count as prompt plus max_tokens when a request starts and are corrected when it ends.

Responses include x-ratelimit-limit-requests, x-ratelimit-remaining-requests, x-ratelimit-limit-tokens and x-ratelimit-remaining-tokens. Need more?Contact us.