Skip to main content

TokenBudget

Defined in the RAG module.
Rust AI Agent SDK Token budget for context management.

Fields

NameTypeDescription
totalusizeTotal available tokens
systemusizeTokens for system prompt
contextusizeTokens for context
responseusizeTokens for response
reservedusizeReserved tokens

Methods

new

fn new(total: usize) -> Self
Create a new token budget Parameters:
NameType
totalusize

available_context

fn available_context(&self) -> usize
Get available context tokens

can_add_context

fn can_add_context(&self, tokens: usize) -> bool
Check if budget allows more context Parameters:
NameType
tokensusize

Source

View on GitHub

praisonai/src/rag/mod.rs at line 347