Skip to main content

​
StreamingRecord

Defined in the profiler module.
Record of streaming operation (LLM responses).

​
Properties

​
name
str
No description available.
​
ttft_ms
float
No description available.
​
total_ms
float
No description available.
​
chunk_count
int
No description available.
​
total_tokens
int
No description available.
​
timestamp
float
No description available.