Dark Web OSINT Tool

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

Product-Info-Crawler is a python web crawler developed using scrapy framework to crawl e-commerce websites for products matching search keyword.

A simple and easy to use web crawler for Python

Tutorial for integrating Oxylabs' Residential Proxies with Selenium in Python

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

A short introduction to scraping with Python with given steps and an example scraper script.

A guide on how to deal with pagination via Python.

A tutorial for parsing JSON data with Python

Learn about how to rotate proxies by using Python.

python web crawler to test theory that repeatedly clicking on the first link on ~97% of wiki pages eventually leads to the wiki page for knowledge 📡

A CLI tool to download a whole website in one click.

A simple python web crawler to fetch weather forecast

Python web crawler with authentication.

Scraping logos of world football clubs from wikipedia

A guide to caching web scraping scripts in Python.

Discover Blue OSINT, an open-source tool for gathering public information online. Ideal for investigators and analysts. 📊🔍 Gather data effortlessly.

WebScraper-Plus is a powerful and flexible Python library for extracting text, links, documents, and images from websites with OCR support, customizable output, and robust CLI/API options.

A Python scraper for Linsol Australia. Extracts deep product data via WordPress API and BeautifulSoup into a Shopify-ready CSV with SEO, specs, and images.

Web Scraping with Python Selenium: Tutorial for Beginners