Skip to main content

Overview

NVIDIA NIM provides optimized inference for embedding models with GPU acceleration.

Quick Start

from praisonaiagents import embedding

result = embedding(
    input="Hello world",
    model="nvidia_nim/NV-Embed-QA"
)
print(f"Dimensions: {len(result.embeddings[0])}")

CLI Usage

praisonai embed "Hello world" --model nvidia_nim/NV-Embed-QA

Setup

export NVIDIA_NIM_API_KEY="your-nvidia-api-key"

Available Models

ModelDimensions
nvidia_nim/NV-Embed-QA1024
nvidia_nim/nvidia/nv-embedqa-e5-v51024