A web app that finds and removes duplicates in your Spotify playlists.

A command-line tool for deduplicating entries in a file or stream.

Project to take two similar zipfiles, and to dedupe files that have the same tiemstamp in the older file.

yet another file deduplicator

Utility for automatic Git repository deduplication

GraphQL response deduplication by mapping entities.

A NiFi processor that deduplicates incoming data using an existing Redis connection pool service.

Analyse 2 paths to found identical files and hard link them to save space

File de-duplicator written in Rust.

CloneReaper is a high performance deduper/deduplicator for Windows, and Linux. With hardlink/symlink support, it enables you to keep files in the same place while saving space. Supports reporting in TXT, JSON, and CSV with optional emails.

Sift duplicate whitespaces away!

A Python pipeline that scrapes news headlines, removes duplicate stories, clusters related articles, and ranks them to produce a clean and relevant news feed.

Automatically identifies and refactors duplicate code patterns across a codebase, suggesting consolidation into reusable functions or classes

Duplicate file finder and de-duplicator. A tool that detects duplicate files and replaces them with symlinks to a shared file in a special shared files folder.