Build software better, together

firecrawl / firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

markdown crawler scraper ai html-to-markdown web-crawler scraping web-scraper web-scraping data-extraction webscraping web-data-extraction ai-agents web-search ai-search web-data llm ai-crawler ai-scraping

Updated Oct 11, 2026
TypeScript

cheeriojs / cheerio

Sponsor

Star

The fast, flexible, and elegant library for parsing and manipulating HTML and XML.

html jquery parser scraper dom cheerio selector hacktoberfest htmlparser2 htmlparser

Updated Oct 10, 2026
TypeScript

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

nodejs javascript npm crawler scraper automation typescript web-crawler headless scraping crawling web-scraping web-crawling headless-chrome apify puppeteer playwright

Updated Oct 11, 2026
TypeScript

getmaxun / maxun

Star

Turn any website into a structured API. Extract, automate, search and monitor the web.

api crawler scraper automation crawling web-scraper self-hosted web-scraping data-extraction webscraping agents browser-automation no-code web-search rpa robotic-process-automation nocode playwright

Updated Oct 8, 2026
TypeScript

mishushakov / llm-scraper

Star

Turn any webpage into structured data using LLMs

scraper browser ai artificial-intelligence openai llama gpt browser-automation puppeteer playwright gpt-4 llm langchain

Updated Sep 10, 2026
TypeScript

zerodytrash / TikTok-Live-Connector

Star

TikTok LIVE API for Node.js: An unofficial library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

Updated Sep 22, 2026
TypeScript

watercrawl / WaterCrawl

Star

Transform Web Content into LLM-Ready Data

crawler scraper html2markdown crawling-python llm-scraper llm-crawler crawl4ai aicrawler

Updated Aug 17, 2026
TypeScript

cyberagiinc / DevDocs

Star

Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App

security documentation scraper typescript python3 cursor cline windsurf playwright llm crawl4ai

Updated Feb 4, 2026
TypeScript

yjl9903 / AnimeGarden

Sponsor

Star

動漫花園镜像站 | 动画 BT 资源聚合站 | 动画 BT 资源开放接口

agent torrent scraper anime skills animation openapi bangumi anitomy dmhy animelist anime-tracker animespace animegarden

Updated Oct 11, 2026
TypeScript

germondai / trawl

Sponsor

Star

Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.

Updated Oct 8, 2026
TypeScript

maoserr / epublifier

Star

Converts some webnovels to epub format

scraper ui epub extension-chrome extension-firefox

Updated Oct 1, 2026
TypeScript

josephlimtech / linkedin-profile-scraper-api

Star

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

Updated Apr 5, 2024
TypeScript

devflowinc / firecrawl-simple

Star

➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are completely removed. Crawl and convert any website into LLM-ready markdown.