Open SourceLibraryFree

Crawl4AI

Open-source async crawler that turns a site into clean, LLM-ready markdown with no API key or account. Apache-2.0; uses a headless browser, so it handles JS-rendered pages.

Homepage ↗Repo ↗

Alternatives

Firecrawl

1 workflow use Crawl4AI

RAGFreeMachine-verified

Crawl4AI: a page to clean, LLM-ready markdown (no API key)

Write a Crawl4AI run script that turns a page into clean markdown with a cache mode set, and verify the script is valid and shaped right before you point it at a site.

Crawl4AI· beginner