deduplicate

Finding and deleting near-duplicate images based on perceptual hash.

ECMAScript proposal for Deduplicating method of Array

File Integrity Manager -

JS script that allows you to remove duplicates from your Last.fm scrobbles library.

Benchmarking javascript array operations

动漫一拍N自动识别算法

A command line tool for sorting photo's from the Synology DSPhoto auto-upload tool

Smart caching for promises. Like memoization, but better.

Package uniq provides primitives for getting the first unique elements of (aka deduplicate) your existing sorted sort.Interface.

A command-line tool for deduplicating entries in a file or stream with constant memory usage

General deduping engine for JDBC sources with output to JDBC/csv targets

Deduplicates maildir contents using hard links.

Deduplication/backup tool with extremely high 'compression' rate

😺一款用于防止重复攻击的组件，基于SPI机制实现核心功能 >>> 防重放组件 (A component used to prevent duplicated attacks, such as repeat request, replay attack)

Create an iterator which returns unique values according to a predicate function.

Create an iterator which returns unique values according to a hash function.

Project to take two similar zipfiles, and to dedupe files that have the same tiemstamp in the older file.

Create an iterator which returns unique values.

Create an iterator which returns the union of two or more iterators.

Deduplication API for Google MusicManager