Official repository for libIEC61850, the open-source library for the IEC 61850 protocols

# SciCat Data Ingestion with TypeScript 📥✨ This repository provides a **TypeScript-based tool** for importing and ingesting data into **SciCat**, the science data catalog used at the **European Spallation Source (ESS)**. --- ## Features ✨ - **Data Ingestion**: Automates data import into SciCat. - **TypeScript Implementation**: Ensures ty

This project ingests YouTube video data related to fishing, stores it in MongoDB, and provides visualizations through Metabase for analysis.

A resilient, prefix-sharded ingestion pipeline for large static breach dumps (e.g. AntiPublic), optimized for low-resource environments (e.g., Raspberry Pi + NAS/SSD).

Lab n°2 of "Applications of Big-Data" @ Efrei Paris

Reliable, production-style data pipeline that ingests data from multiple sources (API, web scraper, CSV), cleans & standardizes with Pandas/NumPy, loads into SQLite, and surfaces insights through a Streamlit dashboard.

The dbsched bundle is preconfigured with the Pado scheduler to periodically execute jobs that dump database tables to CSV files from which it automatically extracts column information to generate the corresponding VersionedPortable classes. It then transforms the CSV records to objects using the generated classes before ingesting them into Hazel…

📊 Fetch free historical candlestick data from the Blofin Exchange API without API keys, saving years of data to CSV for analysis and research.

Ingest data fetched from Snowflake to ElasticSearch

This repository is dedicated to learning LangChain by creating a generative AI application. This web application uses Pinecone as a vector store to answer questions related to LangChain, utilizing sources from the official LangChain documentation.

FastAPI server to process client request both for injection and interference

Merpian Limited - Soverign AI research into personal intelligent assistive nodes

Go implementation for handling huge amounts of http uploads

Performing DataBase Ingester

Efetuar o download de arquivos da web com Python. Inserir dados de um dataframe na cloud Azure com Azure SQL Database. Efetuar transformações nos dados com Azure Data Factory.

Data Ingestion, reading files, working with databases, troubleshooting data, calling APIs and schemas

Apache Airflow to orchestrate AWS Database Migration Service (DMS) tasks for data ingestion.

📈 Fetch free historical candlestick data from Bitget Futures API easily, without API keys, and save clean CSV files for analysis or research.

A framework that eliminates the dependency on Apache Spark by leveraging delta-rs for the creation and management of Delta Lake tables. This framework follows Medallion architecture.

Welcome to the fascinating intersection of Web3, Artificial Intelligence (AI), Open Data Core (ODC), and Composable Enterprise Fabric - a nexus of modern technologies that are significantly reshaping the enterprise landscape