data-consistency

A Python package for diagnostic assessment of data consistency in molecular datasets

A live graphical user interface for the dyClamp sketch

A new package designed to analyze and structure user-submitted text, specifically focusing on community feedback and moderation. The package leverages the capabilities of llmatch-messages to process a

A new package that takes a news headline or short text snippet as input and returns a structured summary of the key details, such as the person involved, the event, and the financial or business impac

This new package facilitates extracting structured insights from text-based content related to domain-specific issues, such as analyzing DNS blocking reports. Given unstructured text describing networ

Networking and Distributed System Programming Project

A tool for recovering and replaying missed events in an event-driven system, ensuring accurate recalculations without relying on traditional databases.

A new package designed to extract and structure key technical specifications from quantum computing research and development texts. The package takes unstructured text input describing quantum process

🇬🇧 Local PDF / XML data comparator that highlights values not found in the other representation, with no API or external service. 🇫🇷 Comparateur local PDF / XML qui signale les valeurs non retrouvées dans l'autre représentation, sans API ni service externe.

Distributed system project implementing a two-phase commit protocol with coordinators and participants. I handled failure cases, ensuring data consistency. The coordinator sends commit requests, and participants vote. Based on votes, the coordinator commits or aborts transactions. I simulated failures and used Python for implementation.

Three-service orchestrated saga with a chaos harness that kills the process at every step boundary and proves compensation converges to a consistent terminal state every time. 7 crash points, 7 consistent recoveries, verified by a money-and-stock conservation oracle. Idempotent under concurrent recovery.

Money-movement ledger proving exactly-once processing: transactional outbox + idempotent applier, verified by a crash harness that killed its processes 46 times mid-flight with zero lost and zero double-applied transfers across 20,000. Includes a control experiment measuring the corruption without dedupe: 32 accounts.

This introductory project demonstrates the importance of verifying data consistency prior to using any ML approach. In this example, we show how to measure possible correlations between the features of the dataset and the corresponding targets.

This program takes in a JSON-like file which is a representation of a bus company database and finds all the mistakes in the data.

面向 AI Agent 的知识状态一致性与增量同步系统：稳定身份、增量更新、失败恢复与并发控制。

Change-data-capture projector from Postgres into denormalized read models with ordering guarantees and replay-from-LSN rebuilds that are byte-identical to the incremental projection. Fixes the lost-update bug most hand-rolled CDC ships: changes from transactions that commit out of LSN order, closed with a transaction-visibility watermark.

Idempotent, resumable partition backfill orchestrator: survives 38 SIGKILLs across 5 chaos trials with checksum-identical results. Atomic staging swaps, fingerprint-driven selective recompute (7 of 90 partitions on late data), transactional SQLite ledger, Airflow dynamic task mapping adapter. 1.2M rows/s on 2 vCPUs.

A transactional outbox relay that guarantees your database and event stream never disagree. Postgres + Kafka/Redpanda, exponential-backoff retries, dead-letter archival to S3/MinIO, and effectively-once delivery. Ports-and-adapters core with zero runtime deps, a real load benchmark, and full production tooling.

🔍 Extract insights from DNS blocking reports and network filtering incidents to quickly identify key information and enhance analysis efficiency.

Physics-informed data consistency and reproducibility audit framework for materials electrochemistry papers.