Skip to main content

get_token_budget

Method
This is a method of the RetrievalConfig class in the retrieval_config module.
Get TokenBudget instance for this config.

Signature

def get_token_budget(model_name: Optional[str]) -> Any

Parameters

model_name
Optional
Optional model name for context window detection

Returns

Returns
Any
TokenBudget configured for this retrieval config