scraping
7 published repositories.
| Repository | |||||
|---|---|---|---|---|---|
| 1 |
firecrawl/firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
|
201.9k | +0.1% | +1.1% | 214 |
| 2 |
D4Vinci/Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
|
103.2k | +0.5% | +3.6% | 135 |
| 3 |
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
|
65.4k | +0.0% | +0.2% | 11 |
| 4 |
soxoj/maigret
🕵️♂️ Collect a dossier on a person by username from 6K websites
|
40.7k | +0.2% | +2.2% | 17 |
| 5 |
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
|
32.8k | +0.0% | +0.5% | 32 |
| 6 |
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
|
26.5k | +0.0% | +0.3% | 7 |
| 7 |
gocolly/colly
Elegant Scraper and Crawler Framework for Golang
|
25.6k | +0.0% | +0.1% | 8 |