Overview
NVIDIA NIM provides optimized inference for embedding models with GPU acceleration.Quick Start
CLI Usage
Setup
Available Models
| Model | Dimensions |
|---|---|
nvidia_nim/NV-Embed-QA | 1024 |
nvidia_nim/nvidia/nv-embedqa-e5-v5 | 1024 |
Generate embeddings using NVIDIA NIM inference microservices
from praisonaiagents import embedding
result = embedding(
input="Hello world",
model="nvidia_nim/NV-Embed-QA"
)
print(f"Dimensions: {len(result.embeddings[0])}")
praisonai embed "Hello world" --model nvidia_nim/NV-Embed-QA
export NVIDIA_NIM_API_KEY="your-nvidia-api-key"
| Model | Dimensions |
|---|---|
nvidia_nim/NV-Embed-QA | 1024 |
nvidia_nim/nvidia/nv-embedqa-e5-v5 | 1024 |