Official repository for libIEC61850, the open-source library for the IEC 61850 protocols

Data ingestion service written in Go

Transform any codebase or techstack in Visual Studio to prompt-friendly text for LLMs!

📊 Fetch free historical candlestick data from the Blofin Exchange API without API keys, saving years of data to CSV for analysis and research.

Simple python interface for the Fivetran API. Powered by HTTPx.

This project implements a full-stack data engineering solution that connects to the Spotify Web API to extract a user’s recently played tracks, stores the data in a PostgreSQL database, applies transformations using dbt, and delivers actionable insights via Metabase dashboards.

The dbsched bundle is preconfigured with the Pado scheduler to periodically execute jobs that dump database tables to CSV files from which it automatically extracts column information to generate the corresponding VersionedPortable classes. It then transforms the CSV records to objects using the generated classes before ingesting them into Hazel…

Lab n°2 of "Applications of Big-Data" @ Efrei Paris

Reliable, production-style data pipeline that ingests data from multiple sources (API, web scraper, CSV), cleans & standardizes with Pandas/NumPy, loads into SQLite, and surfaces insights through a Streamlit dashboard.

Data ingestor that reads and parses executive orders from wikisource

A data pipeline management platform

# SciCat Data Ingestion with TypeScript 📥✨ This repository provides a **TypeScript-based tool** for importing and ingesting data into **SciCat**, the science data catalog used at the **European Spallation Source (ESS)**. --- ## Features ✨ - **Data Ingestion**: Automates data import into SciCat. - **TypeScript Implementation**: Ensures ty

This project ingests YouTube video data related to fishing, stores it in MongoDB, and provides visualizations through Metabase for analysis.

Read-only mirror of https://gitlab.com/sorcero/community/ingestum

A resilient, prefix-sharded ingestion pipeline for large static breach dumps (e.g. AntiPublic), optimized for low-resource environments (e.g., Raspberry Pi + NAS/SSD).

A simple python wrapper script based on pgfutter to load multiple dumped csv files into a postgres database.

Ingest data fetched from Snowflake to ElasticSearch

This repository is dedicated to learning LangChain by creating a generative AI application. This web application uses Pinecone as a vector store to answer questions related to LangChain, utilizing sources from the official LangChain documentation.

FastAPI server to process client request both for injection and interference

Extract YouTube video, feed it to any LLM as knowledge