Skip to main content

get_token_budget

Method
This is a method of the RetrievalConfig class in the retrieval_config module.
Get TokenBudget instance for this config.

Signature

def get_token_budget(model_name: Optional[str]) -> Any

Parameters

model_name
Optional
Optional model name for context window detection

Returns

Returns
Any
TokenBudget configured for this retrieval config

Uses

  • get_model_context_window
  • TokenBudget

Source

View on GitHub

praisonaiagents/rag/retrieval_config.py at line 116