List of libraries, tools and APIs for web scraping and data processing.

The All in One Framework to Build Undefeatable Scrapers

Lightweight web scraping toolkit for documents and structured data.

a reliable high-level web crawling & scraping framework for Node.js.

Pythonic HTML Parsing for Humans™

Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaScript to render data.

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

ProxyCrawl PHP library for scraping and crawling websites

Async fork of Python-TLS-Client with modern asyncio support, updated dependencies, and fixes for issues in the original abandoned library. Includes enhanced compatibility, stability improvements, and ongoing maintenance for Python 3.9–3.13.

🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖

A simple, easy to use, scalable scraping framework written in PHP

🚀 OMKAR TEMP MAIL HELPS YOU USE TEMPORARY EMAILS. 🤖

An API wrapper for Scrappey.com written in Node.js (cloudflare bypass & solver)

🚀 FINAL CODE FOR TUTORIAL ON HOW TO SOLVE CAPTCHA IN SELENIUM USING 2CAPTCHA 🤖

🚀 SCRAPE 1000'S OF PRODUCTS FROM DENTALKART 🤖

✨ NodeJs crawling & scraping framework heavily inspired by Scrapy

A powerful web scraping library built with Playwright that provides a declarative, step-by-step approach to web automation and data extraction.

This Python-based Amazon Scraper is designed to efficiently extract detailed product data from Amazon's product pages. The tool leverages powerful libraries like BeautifulSoup4 and csv, along with the Scrapingant API to simulate browser behavior and bypass Amazon’s anti-scraping algorithms.

The All in One Framework to Build Undefeatable Scrapers

Web scraping API to outsource tons of GET & xpath to cloud computing