Fast, secure, efficient backup program
-
Updated
Sep 1, 2026 - Go
#
dedupe
Here are 134 public repositories matching this topic...
🆔 A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
python clustering dedupe record-linkage python-library entity-resolution datamade dedupe-library de-duplicating
-
Updated
Jul 29, 2025 - Python
Deduplication tool for yarn.lock files
-
Updated
Aug 2, 2026 - TypeScript
Scalable master data management, identity resolution, entity resolution, and deduplication using ML
data-science identity-resolution spark dedupe entity-resolution snowflake fuzzy-matching master-data-management mdm databricks deduplication cdp datalake masterdata dataengineering fuzzymatch dataquality master-data customer-data-platform
-
Updated
Sep 1, 2026 - Java
A powerful and modular toolkit for record linkage and duplicate detection in Python
python machine-learning privacy dedupe record-linkage python-library entity-resolution similarity string-distance deduplication data-matching utrecht-university
-
Updated
Feb 21, 2024 - Python
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
c dictionary dedupe password wordlist remove-duplicates uniq hashes cracking wordlist-generator hashcat unique duplicate-detection password-cracking wordlists
-
Updated
Nov 4, 2025 - C++
Make CSS easier and more maintainable by using JavaScript
-
Updated
Jan 18, 2024 - TypeScript
🆔 Command line tool for deduplicating CSV files
-
Updated
Mar 31, 2020 - Python
🆔 Examples for using the dedupe library
-
Updated
Aug 10, 2024 - Python
Identifying and removing near-duplicate images using perceptual hashing.
-
Updated
Jul 21, 2026 - Python
A fast file deduplicator
-
Updated
Oct 10, 2025 - Rust
📧 CLI to deduplicate mails from mail boxes
python cli mail email dedupe duplicates mailbox maildir mbox deduplication email-tools deduplicate eml dedup duplicate-detection deduplicator mh babyl mmdf email-management
-
Updated
Aug 31, 2026 - Python
Fast block-level out-of-band BTRFS deduplication tool.
-
Updated
Aug 24, 2026 - Rust
Check your files for data corruption and run quick file deduplication
backup dedupe btrfs deduplication data-integrity dedup cloud-backup storage-media disk-check data-degradation bitrot-detection deduper
-
Updated
Mar 4, 2026 - Go
Daxus is a server state management library for React that provides full control over data, leading to a better user experience.
-
Updated
Oct 14, 2024 - TypeScript
Yet Another Dupes Finder
-
Updated
Jul 28, 2026 - Rust
Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
resolution identity awesome identity-resolution resource dedupe record-linkage entity-resolution entities fuzzy-matching entity disambiguation deduplication entity-linking fuzzymatch entity-matching data-matching senzing de-duplicating senzing-community
-
Updated
Aug 31, 2026 - Python
A lightweight fetching library packed with essential features - retries, interceptors, request deduplication and much more, all while still retaining a similar API surface with regular Fetch.
fetch query schema validation dedupe plugins typesafe interceptors retries params fetch-wrapper callapi request-dedupe standard-schema
-
Updated
Aug 28, 2026 - TypeScript
A simple command line interface to the datamade/dedupe library.
-
Updated
Dec 26, 2022 - Jupyter Notebook
Add this topic to your repo
To associate your repository with the dedupe topic, visit your repo's landing page and select "manage topics."