Open

by damned truths

submit your photo


Hall of Fame
View past winners from this year

Please participate in Meta
and help us grow.

Take the 2-minute tour ×
Photography Stack Exchange is a question and answer site for professional, enthusiast and amateur photographers. It's 100% free, no registration required.

I recently imported a large library into Lightroom, I've been going through it and have found several duplicates of the same pictures. They might be in different folders as well. Is there an easy way to remove duplicates? Thanks!

share|improve this question

2 Answers 2

up vote 1 down vote accepted

Whilst I can't recommend this personally, I did stumble across this Lightroom Plugin the other day: http://www.lightroom-plugins.com/DupesIndex.php

share|improve this answer

My go-to method of finding exact dupes is this command line on windows with cygwin or linux.

find /path/to/files/ -name "*.file-extension" -exec md5sum -b {} \; |sort|uniq -w 32 -c|sort -n

The bottom of the list will show the dupe md5 hashed with the path to the first instance of the file.

You can find all copies of that file with:

find /path/to/files/ -name "*.file-extension" -exec md5sum -b {} \;| grep "MD5HASHCODEHERE"

Where MD5HASHCODEHERE is the 32 char long code.

I once did this on 650,000 files to find all the version of the same 8 gif files and it took less than an hour. I don't know if OSX has md5sum installed by default. I can offer a OSX version if needed.

No idea if this is helpful.

share|improve this answer
    
uniq -w option is not available in OSX. md5 is installed or md5sum can be installed through homebrew (md5sha1sum). –  Unapiedra Aug 21 '13 at 21:51

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.