The All in One Framework to Build Undefeatable Scrapers
Web scraping API to outsource tons of GET & xpath to cloud computing
A curated & production-ready collection of tools, frameworks, APIs, proxies, and n8n workflows for B2B web scraping, lead enrichment, data verification, and CRM automation. Built and maintained by Lead Orchestra.
M.A. Thesis work, news scraping framework/pipeline using python, beautifulsoup, newspaper3k, flask and mongodb with a custom api.
This Python-based Amazon Scraper is designed to efficiently extract detailed product data from Amazon's product pages. The tool leverages powerful libraries like BeautifulSoup4 and csv, along with the Scrapingant API to simulate browser behavior and bypass Amazon’s anti-scraping algorithms.
Scrape Amazon products
Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis
Web Scraping
A lightweight template for running Selenium-based web scraping with FastAPI on Railway. It includes headless Chromium, an optimized ChromeDriver setup, and a ready-to-use scraping endpoint, making it ideal for efficient browser automation and dependable data extraction.
An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)
✨ NodeJs crawling & scraping framework heavily inspired by Scrapy
A powerful web scraping library built with Playwright that provides a declarative, step-by-step approach to web automation and data extraction.
🚀 FINAL CODE FOR TUTORIAL ON HOW TO SOLVE CAPTCHA IN SELENIUM USING 2CAPTCHA 🤖
🚀 SCRAPE 1000'S OF PRODUCTS FROM DENTALKART 🤖
🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖
🚀 OMKAR TEMP MAIL HELPS YOU USE TEMPORARY EMAILS. 🤖
A simple, easy to use, scalable scraping framework written in PHP
An API wrapper for Scrappey.com written in Node.js (cloudflare bypass & solver)
ProxyCrawl PHP library for scraping and crawling websites
Async fork of Python-TLS-Client with modern asyncio support, updated dependencies, and fixes for issues in the original abandoned library. Includes enhanced compatibility, stability improvements, and ongoing maintenance for Python 3.9–3.13.
Add a description, image, and links to the scraping-framework topic page so that developers can more easily learn about it.
To associate your repository with the scraping-framework topic, visit your repo's landing page and select "manage topics."