Crawl4AI
Open-source web crawling library optimized for LLM and AI applications.
About
Crawl4AI is an open-source web crawling and scraping library built for LLM and AI pipelines. It converts pages into clean Markdown suitable for RAG and agents, renders JavaScript-heavy sites, and supports concurrent crawling with configurable extraction strategies. It is widely adopted in the open-source community and aims to be a cost-effective alternative to hosted extraction services. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Agents & Orchestration
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Beginner (1/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
Python agent framework that brings Pydantic-style type safety to LLM applications.
Microsoft's framework for building multi-agent AI systems
Lightweight agent framework by Hugging Face for building tool-using AI agents.
Platform for building stateful AI agents with advanced long-term memory and self-improvement.
Memory layer for AI assistants enabling persistent personalized interactions.
Drag-and-drop UI for building LLM flows and AI agents.