Skip to main content

estimate_tokens

Function
This function is defined in the rag module.
Estimate token count for text.

Signature

def estimate_tokens(text: &str) -> usize

Parameters

text
&str
required
No description available.

Returns

Returns
usize
The result of the operation.

Uses

  • token

Source

View on GitHub

praisonai/src/rag/mod.rs at line 415