Evaluator
Defined in the eval module.Rust AI Agent SDK Base trait for evaluators.
Methods
evaluate
Source
View on GitHub
praisonai/src/eval/mod.rs at line 0Guide
Reference
- A2 A
- A2 A Agent Capabilities
- A2 A Agent Card
- A2 A Agent Skill
- A2 A Task
- A2 A Task State
- A GUI
- A GUI Event
- A GUI Event Type
- A GUI Message
- A GUI Role
- A GUI Run Input
- Accuracy Evaluator
- Accuracy Evaluator Builder
- Accuracy Result
- Add Result
- Agent
- Agent App Config
- Agent App Protocol
- Agent Builder
- Agent Config
- Agent Flow
- Agent Metrics
- Agent OS Config
- Agent OS Protocol
- Agent Plugin Protocol
- Agent Protocol
- Agent Team
- Agent Team Builder
- API Stats
- Approval Callback
- Approval Decision
- Array Mode
- Async Display Callback
- Async Guardrail
- Async Stream Callback
- Audio Agent
- Audio Agent Builder
- Audio Config
- Auth Profile
- Auto Agent Spec
- Auto Agents
- Auto Agents Config
- Auto RAG Agent
- Auto RAG Config
- Autonomy Config
- Autonomy Level
- Autonomy Preset
- Blocklist Guardrail
- Bot Action
- Bot Attachment
- Bot Channel
- Bot Config
- Bot Message
- Bot Protocol
- Bot Response
- Bot User
- Budget Allocation
- Budget Level
- Caching Config
- Caching Preset
- Chunking
- Chunking Config
- Chunking Strategy
- Citation
- Citations Mode
- Code Agent
- Code Agent Builder
- Code Config
- Code Execution Result
- Code Execution Step
- Color Palette
- Condition Protocol
- Config Validation Error
- Connection Status
- Console Exporter
- Context Agent
- Context Agent Config
- Context Budgeter
- Context Chunk
- Context Config
- Context Entry
- Context Event
- Context Event Type
- Context Ledger
- Context List Sink
- Context Manager
- Context No Op Sink
- Context Pack
- Context Policy
- Context Preset
- Context Segment
- Context Strategy
- Context Trace Emitter
- Context Trace Sink
- Context Trace Sink Protocol
- Conversation History
- Criteria Evaluator
- Criteria Evaluator Builder
- Criteria Result
- Criteria Score
- DB Adapter
- Deep Research Agent
- Deep Research Agent Builder
- Deep Research Config
- Deep Research Response
- Deep Research Result
- Defaults Config
- Dict Condition
- Display Callback
- Display Event
- Display Event Type
- Display Type
- Document
- Embedding Agent
- Embedding Agent Builder
- Embedding Config
- Embedding Result
- Embedding Usage
- Error
- Error Log
- Evaluation Score
- Evaluator
- Evaluator Config
- Event
- Event Bus
- Event Type
- Execution Config
- Execution Preset
- Expand Prompts
- Expand Result
- Expand Strategy
- Expression Condition
- Failover Config
- Failover Manager
- Failover Status
- Fast Context
- Fast Context Config
- Fast Context Result
- File Match
- File Search Call
- File Session Store
- Flow Display
- Flow Step
- Function Plugin
- Function Stats
- Gateway Client Protocol
- Gateway Config
- Gateway Event
- Gateway Health
- Gateway Message
- Gateway Protocol
- Gateway Session Protocol
- Guardrail
- Guardrail Action
- Guardrail Chain
- Guardrail Config
- Guardrail Preset
- Guardrail Result
- Handoff
- Handoff Chain
- Handoff Config
- Handoff Cycle Error
- Handoff Depth Error
- Handoff Error
- Handoff Filter
- Handoff Filters
- Handoff Input Data
- Handoff Result
- Handoff Timeout Error
- Hook Decision
- Hook Definition
- Hook Event
- Hook Input
- Hook Plugin Protocol
- Hook Registry
- Hook Result
- Hook Runner
- Hooks Config
- If
- Image Agent
- Image Agent Builder
- Image Config
- Image Result
- In Memory Adapter
- In Memory Session Store
- In Memory Vector Store
- Index Stats
- Index Type
- Json File Exporter
- Judge
- Judge Config
- Judge Result
- Knowledge
- Knowledge Backend Error
- Knowledge Builder
- Knowledge Config
- Knowledge Preset
- Knowledge Store Protocol
- LLM Guardrail
- LLM Message
- LLM Plugin Protocol
- Length Guardrail
- Line Range
- LLM Config
- LlmMessage
- LLM Protocol
- LLM Provider
- LLM Response
- Loop
- MCP
- MCP Builder
- MCP Call
- MCP Call Result
- MCP Config
- MCP Content
- MCP Prompt
- MCP Prompt Argument
- MCP Resource
- MCP Server
- MCP Tool
- Manager Config
- Memory
- Memory Adapter
- Memory Backend
- Memory Config
- Memory Message
- Memory Preset
- Memory Protocol
- Message
- Message Type
- Minimal Telemetry
- Mock LLM Provider
- Multi Agent Context Manager
- Multi Agent Execution Config
- Multi Agent Execution Preset
- Multi Agent Hooks Config
- Multi Agent Memory Config
- Multi Agent Output Config
- Multi Agent Output Preset
- Multi Agent Planning Config
- O C R Agent
- O C R Agent Builder
- O C R Config
- O C R Page
- O C R Result
- Obs Collector
- On Error
- Open AI Provider
- Optimizer Strategy
- Output Config
- Output Preset
- Parallel
- Parse Error
- Pattern Guardrail
- Performance Evaluator
- Performance Evaluator Builder
- Performance Metrics
- Performance Monitor
- Performance Report
- Performance Result
- Plan
- Plan Step
- Plan Storage
- Planning Agent
- Planning Agent Config
- Planning Config
- Planning Preset
- Planning Step
- Planning Step Status
- Plugin
- Plugin Hook
- Plugin Info
- Plugin Manager
- Plugin Metadata
- Plugin Parse Error
- Plugin Protocol
- Plugin Registry
- Plugin Type
- Plugins Config
- Plugins Enabled
- Policy Action
- Policy Engine
- Policy Result
- Policy Rule
- Praison Colors
- Praison Config
- Process
- Prompt Expander Agent
- Prompt Expander Agent Builder
- Prompt Expander Config
- Provider
- Provider Status
- Query Mode
- Query Result
- Query Rewriter Agent
- Query Rewriter Agent Builder
- Query Rewriter Config
- RAG
- RAG Builder
- RAG Config
- RAG Result
- Realtime Agent
- Realtime Agent Builder
- Realtime Config
- Reasoning Step
- Reflection Config
- Reflection Output
- Reflection Preset
- Reliability Evaluator
- Reliability Evaluator Builder
- Reliability Result
- Repeat
- Rerank Result
- Reranker Protocol
- Research Citation
- Resolve Options
- Resolved Value
- Resource Limits
- Resource Usage
- Result Ext
- Retrieval Config
- Retrieval Policy
- Retrieval Result
- Retrieval Strategy
- Retriever Protocol
- Rewrite Prompts
- Rewrite Result
- Rewrite Strategy
- Risk Level
- Role
- Route
- Routing Condition Protocol
- Runnable Agent Protocol
- Sandbox Config
- Sandbox Protocol
- Sandbox Result
- Sandbox Status
- Sandbox Status Info
- Scope Required Error
- Search Result
- Search Result Item
- Security Config
- Security Policy
- Session
- Session Config
- Session Data
- Session Info
- Session Message
- Session Store
- Similarity Result
- Simple Reranker
- Skill Loader
- Skill Manager
- Skill Metadata
- Skill Properties
- Skills Config
- Span
- Span Event
- Span Kind
- Span Status
- Step Result
- Step Status
- Stream Callback
- Stream Collector
- Stream Event
- Stream Event Type
- Stream Handler
- Stream Metrics
- String Mode
- Task
- Task Builder
- Task Config
- Task Output
- Task Status
- Task Type
- Telemetry Collector
- Telemetry Context
- Telemetry Event
- Telemetry Event Type
- Template Config
- Thinking Budget
- Thinking Budget Builder
- Thinking Config
- Thinking Tracker
- Thinking Usage
- Todo Item
- Todo List
- Todo Priority
- Token Budget
- Token Usage
- Tool
- Tool Call
- Tool Call Data
- Tool Call Function
- Tool Call Result
- Tool Definition
- Tool Plugin Protocol
- Tool Protocol
- Tool Registry
- Tool Result
- Tool Schema
- Trace Context
- Trace Context Data
- Trace Event
- Trace Exporter
- Trace Sink Protocol
- Tracer
- Transport Config
- Transport Type
- Usage
- Validation Error
- Vector Record
- Vector Store Protocol
- Video Agent
- Video Agent Builder
- Video Config
- Video Result
- Video Status
- Vision Agent
- Vision Agent Builder
- Vision Config
- Web Config
- Web Preset
- Web Search Call
- Web Search Provider
- Workflow Context
- Workflow Step Execution Preset
Classes
Evaluator • Rust AI Agent SDK
Evaluator: Base trait for evaluators.
⌘I