Big Data
Download and parse Whois records from bulk whois database dumps of IANA organizations (ARIN, AFRINIC, APNIC, LACNIC, RIPE ). Crawl and parse RWhois records from RFC 2167 ARIN Referral Whois Servers
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Apache Camel is an open source integration framework that empowers you to quickly and easily integrate various systems consuming or producing data.
A framework for building integrations and APIs
A robust two way (bidirectional) file sync script based on rsync with fault tolerance, POSIX ACL support, time control and near realtime sync
A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.
Website for storing flight information, rendering paths on a zoomable world map and calculating statistics, with plenty of free airline, airport and route data.
A curated list of awesome big data frameworks, ressources and other awesomeness.
A collection of awesome web crawler,spider in different languages
Community list of awesome projects, apps, tools, pinning services and more related to IPFS.
A curated list of awesome data labeling tools
Scalable datastore for metrics, events, and real-time analytics
A time-series database for high-performance real-time analytics packaged as a Postgres extension
Carbon is one of the components of Graphite, and is responsible for receiving metrics over the network and writing them down to disk using a storage backend.
QuestDB is a high performance, open-source, time-series database
A scalable, distributed Time Series Database.
Extension for more hyperfunctions, fully compatible with TimescaleDB and PostgreSQL 📈
A tool for tuning TimescaleDB for better performance by adjusting settings to match your system's CPU and memory resources.
Expose hardware sensor data to Graphite / InfluxDB / Prometheus / Postgres / Timescaledb
.NET library to instrument your code with Prometheus metrics
IA's public Wayback Machine (moved from SourceForge)
high performance .NET driver for Apache Cassandra
Reference application for using Cassandra, DataStax Enterprise, and .NET
High-performance MySQL proxy with a GPL license.
In-depth attack surface mapping and asset discovery