Dublette

Deduplicate images and videos using perceptual hashing

Dublette scans a directory for visually similar media files and removes the duplicates. Unlike byte-level comparison, it uses perceptual hashing to detect files that look the same even if they differ in format, compression, or metadata.

Features

• Perceptual hashing -- detects visually similar images and videos, not just byte-identical copies
• Image and video support -- handles jpg, png, gif, webp, bmp, tiff, and 9 video formats via ffmpeg
• Dry-run mode -- preview what would be deleted before committing
• JSON output -- machine-readable output for scripting and CI pipelines
• Parallel processing -- hashes files concurrently using all available cores
• Configurable threshold -- tune sensitivity with hamming distance control

Quick Start

Install dublette from a pre-compiled binary or via cargo:

cargo install dublette

Preview duplicates:

dublette ~/Photos --dry-run

Delete duplicates:

dublette ~/Photos --yes

Documentation

Full documentation available at dublette.sripwoud.xyz:

• Installation - Detailed setup guide
• Quick Start - Step-by-step walkthrough
• CLI Reference - All options documented
• How It Works - Perceptual hashing explained

Requirements

• (Optional) ffmpeg for video deduplication

Community

• Documentation
• Report Issues