Skip to content
#

content-extraction

Here are 145 public repositories matching this topic...

Aether: JSON + TOON-powered, robots.txt-compliant open-web retrieval for AI pipelines. A high-performance Go library with SmartQuery routing, article extraction, metadata normalization, RSS/Atom parsing, OpenAPI connectors, caching layers, plugin systems, & JSONL/TOON streaming - a fully free alternative to paid web-search APIs for AI applications.

  • Updated Dec 11, 2025
  • Go

A robust, modular web crawler built in Python for extracting and saving content from websites. This crawler is specifically designed to extract text content from both HTML and PDF files, saving them in a structured format with metadata.

  • Updated Nov 18, 2024
  • Python

Improve this page

Add a description, image, and links to the content-extraction topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the content-extraction topic, visit your repo's landing page and select "manage topics."

Learn more