Headless chrome/chromium automation library (unofficial port of puppeteer)

Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

💫 Industrial-strength Natural Language Processing (NLP) in Python

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. Docs 文档 👉

use multiple proxies with Scrapy

A service daemon to run Scrapy spiders

Headless chrome/chromium automation library (unofficial port of puppeteer)

A scalable frontier for web crawlers

A Python wrapper for Google Tesseract

Extract embedded metadata from HTML markup