Polite, reproducible web harvesting: fetch once, parse forever. Resumable crawls, offline re-parsing, RFC 9309 robots.txt, provenance on every record. Built on Scrapling.
-
Updated
Oct 3, 2026 - Python
The OAI Protocol for Metadata Harvesting (OAI-PMH) is an API using XML over HTTP to retrieve metadata about archived digital publications. It allows to get record updates in Dublin Core and other metadata formats. In contrast to RSS and ATOM Feeds, updates can also be selected by date.
Polite, reproducible web harvesting: fetch once, parse forever. Resumable crawls, offline re-parsing, RFC 9309 robots.txt, provenance on every record. Built on Scrapling.
Daily arXiv briefings + weekly trend & gap analysis. Surfaces research-industry mismatches and potential startup ideas from machine learning, robotics, hardware, and quant-finance papers.
This is an experimental service to generate IIIF manifests for KENOM (http://kenom.de) on-the-fly from OAI/LIDO data.
Queensland University of Technology — independent third-party profile of a public API surface, by API Evangelist. Queensland University of Technology (QUT) is a public research university based in Brisbane, Australia, ranked #213 in the QS World University Rankings 2025. QUT serves around 50,000 students with an applied emphasis in teaching and res
Harvesting des Publikationsservers miami der WWU Münster und Transformation in METS/MODS für das Portal noah.nrw
Trinity College Dublin — independent third-party profile of a public API surface, by API Evangelist. Trinity College Dublin (the University of Dublin) is Ireland's oldest university, founded in 1592, and ranked #98 in the QS World University Rankings 2025. Its public developer/API footprint is not organized around a dedicated developer portal or a
World Bank document metadata scraping with R and the World Bank's Open Knowledge Repository using OAI-PMH standards.
Pemeriksa OAI-PMH untuk jurnal OJS dengan Streamlit, diagnosis harvestability, dan rekomendasi perbaikan.
Harbin Institute of Technology — independent third-party profile of a public API surface, by API Evangelist. Harbin Institute of Technology (HIT) is a public research university in Harbin, Heilongjiang, China, founded in 1920 and overseen by the Ministry of Industry and Information Technology, with additional campuses in Weihai and Shenzhen. It is
Research work by Evgeny Simonenko (in Russian language).
e-periodica OAI-PMH - Ethnology and Folklore
OAI-PMH harvester for Digital Commons repositories - one schema across institutions
Public documentation for the Southeast Asian Serials Database (SEALIB), with REST API v1 and OAI-PMH 2.0 support.
Unofficial, synchronous Python client for Swiss legal commentaries via Onlinekommentar.