Quick Start
Token Options
| Option | Description |
|---|---|
max_tokens | Maximum per request |
max_context | Context window limit |
truncation | How to handle overflow |
Related
Budget
Cost control
Context
Context management
Manage token usage and costs
| Option | Description |
|---|---|
max_tokens | Maximum per request |
max_context | Context window limit |
truncation | How to handle overflow |