Create agents that monitor and act on your behalf. Your agents are standing by!

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

Python scraper based on AI

LLM based autonomous agent that conducts local and web research on any topic and generates a comprehensive report with citations.

A cli tool to browse and play anime

List of libraries, tools and APIs for web scraping and data processing.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

Web Scraper in Go, similar to BeautifulSoup

Scrapoxy is a super proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than spreading it across multiple scrapers 🕸️. It also smartly handles traffic routing 🔀 to minimize bans and increase success rates 🚀.

The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

Vision utilities for web interaction agents 👀

👻 Experimental library for scraping websites using OpenAI's GPT API.

Persistent HTTP cache for python requests

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping

Creating Scrapy scrapers via the Django admin interface

Lightweight library for scraping web-sites with LLMs

🥫 The simple, fast, and modern web scraping library

Suck the InTernet