gitpulse

scraping

7 个已发布仓库。

仓库
1
firecrawl/firecrawl Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
201.9k +0.1%+1.1%+5.5% 214
2
D4Vinci/Scrapling 🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
103.2k +0.5%+3.6%+18.0% 135
3
scrapy/scrapy Scrapy, a fast high-level web crawling & scraping framework for Python.
65.4k +0.0%+0.2%+0.9% 11
4
soxoj/maigret 🕵️‍♂️ Collect a dossier on a person by username from 6K websites
40.7k +0.2%+2.2%+4.5% 17
5 32.8k +0.0%+0.5%+3.2% 32
6
apify/crawlee Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
26.5k +0.0%+0.3%+1.2% 7
7
gocolly/colly Elegant Scraper and Crawler Framework for Golang
25.6k +0.0%+0.1%+0.2% 8