Stream PostgreSQL queries using NDJSON
-
Updated
Jun 16, 2017 - Python
Stream PostgreSQL queries using NDJSON
Parallel NDJSON Reader for Python
Programmable text file splitter
Batch importer for MariaDB. Used it to import millions of reddit post entries from a ndjson file.
ndjson with the same interface as the builtin json module
A lightweight, high-performance Python library for parsing jsonl files.
You have directories containing data files and specification files. The specification files describe the structure of the data files. Write an app that reads format definitions from specification files. Use these definitions to convert the parsed files to NDJSON files.
FastAPI Request Response Logger in ndjson.
3-node Elasticsearch demo with Kibana + Cerebro on a single VM. Includes a tiny Python ingester for Simple English Wikipedia (Cirrus dumps), and health checks.
Lightweight Python Market-data CLI to normalize & store top-of-book, then replay with timing for execution backtests
Structured JSON logging for ML experiments: schema-validated events, run context, pluggable sinks (stdout/file/Logstash, optional GCP), redaction, buffering, and summary emission.
Reference tooling for ICEP: schema validation, event-log utilities, example artifacts.
Infer robust Pydantic v2 models from messy, evolving JSON streams
Privacy-first personal data engine — schema-driven ingestion, canonical entity modeling, and local-first data pipelines
Add a description, image, and links to the ndjson topic page so that developers can more easily learn about it.
To associate your repository with the ndjson topic, visit your repo's landing page and select "manage topics."