Skip to main content

Overview

Crawl4AI is an open-source, LLM-friendly web crawler that extracts clean content from websites.

Installation

pip install "praisonai[tools]"

Quick Start

from praisonai_tools import Crawl4AITool

# Initialize
crawler = Crawl4AITool()

# Crawl
result = crawler.crawl("https://example.com")
print(result)

Usage with Agent

from praisonaiagents import Agent
from praisonai_tools import Crawl4AITool

agent = Agent(
    name="WebCrawler",
    instructions="You crawl websites and extract content.",
    tools=[Crawl4AITool()]
)

response = agent.chat("Crawl https://docs.praison.ai and summarize")
print(response)

Available Methods

crawl(url)

Crawl a URL and extract content.
from praisonai_tools import Crawl4AITool

crawler = Crawl4AITool()
result = crawler.crawl("https://example.com")

Common Errors

ErrorCauseSolution
crawl4ai not installedMissing dependencyRun pip install crawl4ai
TimeoutPage too slowIncrease timeout