Skip to main content

​
eval

Rust AI Agent SDK Evaluation Module for PraisonAI Rust SDK. Provides comprehensive evaluation capabilities for AI agents.

​
Example

use praisonai::eval::{AccuracyEvaluator, EvaluationScore};

let evaluator = AccuracyEvaluator::new()
.input("What is 2+2?")
.expected("4")
.build();

let result = evaluator.run().await?;
println!("Score: {}", result.score);

​
Import

use praisonai::eval::*;

​
Classes

EvaluationScore

Score from an evaluation.

PerformanceMetrics

Performance metrics from an evaluation.

ToolCallResult

Result of a tool call during evaluation.

CriteriaScore

Score for a specific criterion.

AccuracyResult

Result from an accuracy evaluation.

PerformanceResult

Result from a performance evaluation.

ReliabilityResult

Result from a reliability evaluation.

CriteriaResult

Result from a criteria evaluation.

EvaluatorConfig

Configuration for evaluators.

AccuracyEvaluator

Evaluator for accuracy (comparing output to expected).

AccuracyEvaluatorBuilder

Builder for AccuracyEvaluator.

PerformanceEvaluator

Evaluator for performance metrics.

PerformanceEvaluatorBuilder

Builder for PerformanceEvaluator.

ReliabilityEvaluator

Evaluator for reliability (tool call verification).

ReliabilityEvaluatorBuilder

Builder for ReliabilityEvaluator.

CriteriaEvaluator

Evaluator for custom criteria.

CriteriaEvaluatorBuilder

Builder for CriteriaEvaluator.

JudgeConfig

Configuration for a judge.

JudgeResult

Result from a judge.

Judge

A judge for evaluating outputs.

Evaluator

Base trait for evaluators.

Rust Evaluation

Rust Criteria