Documentation Index
Fetch the complete documentation index at: https://docs.praison.ai/llms.txt
Use this file to discover all available pages before exploring further.
Overview
Infinity is a high-performance self-hosted embedding server that supports various open-source models.
Quick Start
from praisonaiagents import embedding
result = embedding(
input="Hello world",
model="infinity/BAAI/bge-small-en-v1.5",
api_base="http://localhost:7997"
)
print(f"Dimensions: {len(result.embeddings[0])}")
CLI Usage
praisonai embed "Hello world" --model infinity/BAAI/bge-small-en-v1.5
Setup
- Install and run Infinity server:
pip install infinity-emb
infinity_emb --model-name-or-path BAAI/bge-small-en-v1.5
- Set environment variable:
export INFINITY_API_BASE="http://localhost:7997"