Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase
-
Updated
Nov 7, 2025 - Python
#
ingestion
Here are 148 public repositories matching this topic...
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
-
Updated
Nov 6, 2025 - Java
Open Source Metering and Usage Based Billing API ⭐️ Consumption tracking, Subscription management, Pricing iterations, Payment orchestration & Revenue analytics
react ruby go open-source events analytics clickhouse invoices payments self-hosted pricing fintech ingestion billing subscriptions metering usage-based-billing pricing-data-science
-
Updated
Nov 7, 2025 - Go
OpenSearch Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.
-
Updated
Nov 8, 2025 - Java
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
microsoft streaming real-time scala kafka spark apache-spark stream connector azure bigdata apache spark-streaming eventhubs ingestion continuous event-hubs databricks structured-streaming
-
Updated
Feb 14, 2025 - Scala
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
python rust machine-learning information-retrieval server high-performance production inference indexing rust-lang ingestion hybrid embedding-models rag vector-search onnxruntime vector-database onnx-runtime large-language-models vision-language-model
-
Updated
Nov 8, 2025 - Rust
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
-
Updated
Nov 7, 2025 - Go
A free, open-source, web-based self-service BI tailor-made for clickhouse, google bigquery, mysql, postgresql, vertica
mysql bigquery data dashboard etl analytics clickhouse bigdata postgresql ingestion hacktoberfest vertica bussiness-intelligence hacktoberfest2023
-
Updated
Nov 21, 2024 - TypeScript
✨ A extension can help you open git ingest to turn any git repository into a prompt-friendly text ingest for LLMs.
chrome-extension chrome browser ai firefox-addon code prompt ingestion browser-extension chrome-extensions claude llm chatgpt gitingest
-
Updated
Aug 6, 2025 - TypeScript
IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.
workflow hadoop ingestion oozie sqoop sqoop2 workflow-automation workflow-scheduler hadoop-ecosystem hadoop-framework ibis cigna
-
Updated
Apr 13, 2022 - Python
Media Management System: ingestion, processing, encoding, delivery, ...
opencv encoding workflow cloud video computer-vision ffmpeg download encoder workflow-engine overlay media cut ingestion delivery-api workflows concatenate delivery
-
Updated
Nov 9, 2025 - C++
Extensible streaming ingestion pipeline on top of Apache Spark
streaming framework kafka spark apache-spark pipeline ingestion streaming-etl spark-structured-streaming
-
Updated
Jul 17, 2025 - Scala
Spark in Action, 2e - chapter 9 - Advanced ingestion: finding data sources and building your own
-
Updated
Apr 21, 2023 - Java
Official NetBox Labs plugin for NetBox for Diode
-
Updated
Nov 5, 2025 - Python
Diode data model and ingestion services for NetBox, from NetBox Labs
-
Updated
Nov 3, 2025 - Go
Use local files or public GitHub repository as a source and ask questions through ChatGPT about it
-
Updated
Oct 9, 2023 - TypeScript
A simple project to analyze events in Paris using open source data provided by the city of Paris.
-
Updated
Aug 18, 2025
-
Updated
Dec 4, 2018 - Scala
Improve this page
Add a description, image, and links to the ingestion topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ingestion topic, visit your repo's landing page and select "manage topics."