7

I recently imported a large library into Lightroom, I've been going through it and have found several duplicates of the same pictures. They might be in different folders as well. Is there an easy way to remove duplicates? Thanks!

1

Whilst I can't recommend this personally, I did stumble across this Lightroom Plugin the other day: http://www.lightroom-plugins.com/DupesIndex.php

1

My go-to method of finding exact dupes is this command line on windows with cygwin or linux.

find /path/to/files/ -name "*.file-extension" -exec md5sum -b {} \; |sort|uniq -w 32 -c|sort -n

The bottom of the list will show the dupe md5 hashed with the path to the first instance of the file.

You can find all copies of that file with:

find /path/to/files/ -name "*.file-extension" -exec md5sum -b {} \;| grep "MD5HASHCODEHERE"

Where MD5HASHCODEHERE is the 32 char long code.

I once did this on 650,000 files to find all the version of the same 8 gif files and it took less than an hour. I don't know if OSX has md5sum installed by default. I can offer a OSX version if needed.

No idea if this is helpful.

  • uniq -w option is not available in OSX. md5 is installed or md5sum can be installed through homebrew (md5sha1sum). – Unapiedra Aug 21 '13 at 21:51
1

The Teekesselchen add-on works well too.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.