Crawlee
Web scraping and browser automation library by Apify for Node.js and Python.
About
Crawlee by Apify is a web scraping and browser automation library for Node.js and Python that handles crawling end to end. It supports plain HTTP crawling and headless Chrome through Playwright, automatic concurrency scaling, proxy rotation, and human-like behavior to avoid bot detection, storing results to disk or cloud. A CLI scaffolds a project with dependencies. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- RAG & Document Retrieval
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
All-in-one desktop and Docker app for private LLM chat with your documents.
Modular open-source RAG framework for building production document retrieval applications.
Open-source data extraction and indexing engine for RAG applications.
Open-source embedding database for AI applications
Web scraping API that turns websites into clean LLM-ready markdown.
Cloud-native vector database for scalable similarity search