gitpulse

web-crawler

5 published repositories.

Repository
1
firecrawl/firecrawl Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
201.9k +0.1%+1.1%+5.5% 214
2
unclecode/crawl4ai Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
87.4k +0.0%+0.3%+2.2% 95
3 32.8k +0.0%+0.5%+3.2% 32
4
apify/crawlee Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
26.5k +0.0%+0.3%+1.2% 7
5
lexmount/moli Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
23.8k +0.3%+3.5%+30.8% 245