Code
Set model by 3 ways
1. OpenAI Compatible Endpoints
By Default it uses OPENAI_BASE_URL https://api.openai.com/v1
2. Litellm Compatible model names (eg: gemini/gemini-1.5-flash-8b)
3. Litellm Compatible Configuration
Advanced Configuration (Litellm Support)
This uses Litellm
1
Install Package
Install required packages:
2
Setup Environment
3
Create Agent
Create
app.py:Ollama Integration
Ollama Integration
Groq Integration
Groq Integration
Google Gemini
Google Gemini
Jan AI Integration
Jan AI Integration
LM Studio Integration
LM Studio Integration
OpenRouter Integration
OpenRouter Integration

