Skip to main content

OpenAI Compatible Provider

Connect to any OpenAI-compatible API endpoint.

Environment Variables

export OPENAI_COMPATIBLE_API_KEY=...
export OPENAI_COMPATIBLE_BASE_URL=https://api.example.com/v1

Quick Start

import { Agent } from 'praisonai';

const agent = new Agent({
  name: 'CompatibleAgent',
  instructions: 'You are a helpful assistant.',
  llm: 'openai-compatible/my-model',
  llmConfig: {
    baseUrl: 'https://api.example.com/v1',
    apiKey: process.env.OPENAI_COMPATIBLE_API_KEY
  }
});

const response = await agent.chat('Hello!');

Compatible Services

  • vLLM
  • LocalAI
  • Text Generation Inference
  • Anyscale
  • Custom deployments