Skip to main content

​
calculate_quality_metrics

Method
This is a method of the Memory class in the memory module.
Calculate quality metrics using LLM

​
Signature

def calculate_quality_metrics(output: str, expected_output: str, llm: Optional[str], custom_prompt: Optional[str]) -> Dict[str, float]

​
Parameters

​
output
str
required
No description available.
​
expected_output
str
required
No description available.
​
llm
Optional
No description available.
​
custom_prompt
Optional
No description available.

​
Returns

​
Returns
Dict[str, float]
The result of the operation.

​
Uses

  • logger.info
  • litellm.completion
  • OpenAI
  • create
  • logger.error
  • json.loads
  • ValueError

​
Used By

​
Source

View on GitHub

praisonaiagents/memory/memory.py at line 1636