Web: Browser Tools
A browser automation framework and ecosystem.
Open-source, vision-first browser agent
Free, simple, and intuitive online database diagram editor and SQL generator.
🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data
Visualizer for neural network, deep learning and machine learning models
🌐 Make websites accessible for AI agents. Automate tasks online with ease.
Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
A feature-rich command-line audio/video downloader
Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
The AI Browser Automation Framework
🕷️ An undetectable, powerful, flexible, high-performance Python library to make Web Scraping Easy and Effortless as it should be!
Exa MCP for web search and web crawling!
Turn any website into clean data pipelines & structured APIs in minutes!
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo…
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
☁️ The fastest markdown to HTML streamer built with JavaScript. Optimized for LLM input.
List of anti-detect and humanizing tools and browsers, including captcha solvers and sms-activation.
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase
小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫、百度贴吧帖子 ｜ 百度贴吧评论回复爬虫 | 知乎问答文章｜评论爬虫
⚡️ Streaming torrent client for the web
A next-generation crawling and spidering framework.
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
Scrapy, a fast high-level web crawling & scraping framework for Python.
Extract and decrypt browser data, supporting multiple data types, runnable on various operating systems (macOS, Windows, Linux).
Command-line program to download videos from YouTube.com and other video sites