Crawlee
Web scraping and browser automation library by Apify for Node.js and Python.
About
Crawlee by Apify is a web scraping and browser automation library for Node.js and Python that handles crawling end to end. It supports plain HTTP crawling and headless Chrome through Playwright, automatic concurrency scaling, proxy rotation, and human-like behavior to avoid bot detection, storing results to disk or cloud. A CLI scaffolds a project with dependencies. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- RAG & Document Retrieval
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
Self-hosted application layer for LLMs with chat, RAG, web search, code execution, and agents.
Open-source data extraction and indexing engine for RAG applications.
Open-source embedding database for AI applications
Web scraping API that turns websites into clean LLM-ready markdown.
Local RAG capabilities in GPT4All for chatting with documents privately.
Cloud-native vector database for scalable similarity search