Overview
The completions capability provides access to chat and text completion APIs through LiteLLM, supporting multiple providers.Python Usage
Chat Completion
Text Completion (Legacy)
Async Usage
Parameters
| Parameter | Type | Default | Description |
|---|---|---|---|
messages | List[Dict] | Required | List of message objects |
model | str | ”gpt-4o-mini” | Model to use |
temperature | float | 1.0 | Sampling temperature |
max_tokens | int | None | Maximum tokens to generate |
tools | List[Dict] | None | List of tools |
timeout | float | 600.0 | Request timeout in seconds |
api_key | str | None | API key override |
Result Object
TheCompletionResult object contains:
id: Response IDcontent: Generated textrole: Message role (“assistant”)model: Model usedfinish_reason: Why generation stoppedusage: Token usage statisticstool_calls: Any tool calls made

