An AI-ready modular C/C++ web crawler framework with a pluggable pipeline architecture.
c crawler information-retrieval cpp web-crawler multithreading libcurl data-extraction data-pipeline data-ingestion system-design modular-architecture ai-ready crawler-framework
-
Updated
Mar 23, 2026 - C++