Firecrawl

Use Firecrawl with Agno agents.

Enable Agno agents to scrape and convert entire website content into clean, structured Markdown specifically optimized for LLMs by integrating with Firecrawl.

Prerequisites

• Create a Firecrawl account and get an API key
• Set the API key as an environment variable: export FIRECRAWL_API_KEY=<your-api-key>

from agno.agent import Agent
from agno.tools.firecrawl import FirecrawlTools

# ---------------------------------------------------------------------------
# Create Agent
# ---------------------------------------------------------------------------

agent = Agent(
    tools=[
        FirecrawlTools(
            enable_scrape=False, enable_crawl=True, enable_search=True, poll_interval=2
        )
    ],
    markdown=True,
)

# Should use search

# ---------------------------------------------------------------------------
# Run Agent
# ---------------------------------------------------------------------------
if __name__ == "__main__":
    agent.print_response(
        "Search for the web for the latest on 'web scraping technologies'",
        formats=["markdown", "links"],
    )

    # Should use crawl
    agent.print_response("Summarize this https://docs.agno.com/introduction/")

Run the Example

# Clone and setup repo
git clone https://github.com/agno-agi/agno.git
cd agno/cookbook/91_tools

# Create and activate virtual environment
./scripts/demo_setup.sh
source .venvs/demo/bin/activate

python firecrawl_tools.py

For details, see Firecrawl cookbook.