deduplicate_topics
Function
This function is defined in the manager module.Programmatic deduplication of topics/items before agent processing. This helps prevent duplicate content from being passed to downstream agents, reducing token waste and improving quality.
Signature
Parameters
List of topic dicts or strings
Key to use for comparison if topics are dicts (default: “title”)
Similarity threshold for fuzzy matching (0.0-1.0)
Returns
Deduplicated list of topics