Cache
Cache provides response caching to reduce API costs and improve response times.Available Providers
| Provider | Description |
|---|---|
MemoryCache | In-memory cache |
FileCache | File-based persistent cache |
Response caching for LLM calls
| Provider | Description |
|---|---|
MemoryCache | In-memory cache |
FileCache | File-based persistent cache |