PerRequestLimits - Python SDK

PerRequestLimits method reference

The Python SDK and docs are currently in beta. Report issues on GitHub.

Per-request token limits

Fields

FieldTypeRequiredDescriptionExample
completion_tokensfloat✔️Maximum completion tokens per request1000
prompt_tokensfloat✔️Maximum prompt tokens per request1000