Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase
-
Updated
Nov 5, 2025 - Python
#
ingestion
Here are 45 public repositories matching this topic...
Official NetBox Labs plugin for NetBox for Diode
-
Updated
Oct 30, 2025 - Python
IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.
workflow hadoop ingestion oozie sqoop sqoop2 workflow-automation workflow-scheduler hadoop-ecosystem hadoop-framework ibis cigna
-
Updated
Apr 13, 2022 - Python
Python script for ingesting various files into a semantic graph. For text, images, cpp, python, rust, javascript, and PDFs.
-
Updated
Sep 17, 2024 - Python
This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
python java machine-learning streaming apache-spark spring-boot hbase pyspark hdfs ingestion apache-kafka postgresql-database powerbi batch-processing lambda-architecture apache-airflow big-data-projects
-
Updated
Apr 15, 2024 - Python
Python Open-source ETL tool for seamless data movement across PostgreSQL, MySQL, Redshift, BigQuery, S3, GCS, and CSV files, with yaml/json-based configuration.
-
Updated
May 25, 2025 - Python
Periodically ingest incremental updates (inserts / deletes) into BigQuery using Cloud Composer / Airflow orchestration workflow
bigquery airflow google composer cloud gcp operator dataflow ingestion periodic dag change-data inceremental merge-query bigqueryoperator dataflowtemplateoperator
-
Updated
Dec 12, 2019 - Python
Tagbase is a data lifecycle management system for electronic timeseries sensor data. It supports different types of data and works with equipment from various manufacturers.
docker sql rest-api postgresql postgis interoperability oceanography ingestion insitu tagbase-server etuff
-
Updated
Oct 7, 2025 - Python
Read-only mirror of https://gitlab.com/sorcero/community/ingestum
-
Updated
Jan 23, 2023 - Python
Extract Transform and Load unstructured data into the Clarifai's AI platform
ingestion dataengineering dataanalysis unstructured-data unstructured-text ingestion-pipeline unstructured-data-analysis unstructured-image
-
Updated
Oct 22, 2025 - Python
A highly efficient, composable, and lightweight ETL and data integration framework.
python data-science data big-data pipeline etl analytics arrow ingress postgresql s3 ml data-engineering olap data-integration ingestion elt duckdb polars
-
Updated
Oct 11, 2025 - Python
A fully interactive tool designed to streamline your GitHub repository prompt generation process and facilitate RAG (Retrieval-Augmented Generation) workflows
github python open-source app ai repository code prompt ingestion rag llm langchain retrieval-augmented-generation
-
Updated
Jan 5, 2025 - Python
LogFlow é uma aplicação ETL (Extração, Transformação e Carregamento) especializada em processamento de logs
security kafka etl graylog logs log-collector ingestion winlogbeat log-management opensearch etl-pipeline
-
Updated
Apr 17, 2025 - Python
Simple python interface for the Fivetran API. Powered by HTTPx.
python integration etl data-engineering api-wrapper dataops ingestion yaml-configuration iaac fivetran httpx
-
Updated
Jun 5, 2024 - Python
Easily fetch free historical Binance Futures candlestick (OHLCV candle) data with this simple and powerful Python script. Download years of data (e.g., 2021–2025) for any symbol and interval — all without API keys or paid plans.
fetch python csv symbols free ingestion candle fetcher historical-data historical csv-export candlestick timeframe binance binance-api ingestion-pipeline binance-automation
-
Updated
Oct 20, 2025 - Python
Automate data ingestion into FiftyOne with Twilio
-
Updated
Oct 24, 2023 - Python
A MongoDb to Elasticsearch ETL pipeline
-
Updated
Oct 3, 2017 - Python
Improve this page
Add a description, image, and links to the ingestion topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ingestion topic, visit your repo's landing page and select "manage topics."