Custom file and directory checksum and verification tool
-
Updated
Dec 21, 2025 - Python
Custom file and directory checksum and verification tool
File de-duper tool based on xxhash algorithm for faster file comparison.
lightweigth function decorators to cache your `pandas.DataFrame` as feather.
fipsified version of xxHash (https://github.com/Cyan4973/xxHash)
High-performance, hardware-aware Layer 0 deduplication engine. Uses 4-tier short-circuit logic (Size → Fringe → Full Hash) with xxHash128 to eliminate exact duplicates before they enter your processing pipeline. Python 3.11+, uv, SQLite.
Secure Hotfix System with Dynamic Hash-Based Verification
Simple file integrity checker
A high-performance Change Data Capture (CDC) tool for comparing CSV files and detecting differences. Built with Python and optimized for speed using Polars, NumPy, and xxHash.
Find duplicate files
One-command determinism + manifest for ML projects.
Add a description, image, and links to the xxhash topic page so that developers can more easily learn about it.
To associate your repository with the xxhash topic, visit your repo's landing page and select "manage topics."