I have 15 years or digital photos and I am in the process of creating a 'master archive'. The photos are spread across multiple HDDs with different folder structures, with many duplicate photos. I am looking for a script or off-the-shelf app which will scan a HDD for any photos (common file formats, mainly JPEGs) and give me a list of the photos which are NOT in the master archive. I can then manually add the photos into the archive (It pretty much needs to be done manually so I can categorize them as I go, but I am ok with that).
I have searched the web extensively and cannot find a straightforward way to do this (which does surprise me - I can't be the only person in the world with a messy collection of photos across multiple HDDs looking to sort it out!). Most duplicate finding software focuses on finding the duplicates - I want to find the EXCEPTIONS, those missing from the master archive. Synchronization software is good at finding the exceptions (missing files), but most expect folder structures to be the same - As I have tried a few categorization methods over the years, the folder structures aren't identical.
99%+ of the photos will be bit-identical copies with identical timestamps. I don't need to worry about getting file hashes/checksums or finding resized versions of the same file or visually similar photos. Besides. doing that on 1TB of photos would take too long anyway.
Can anyone think of a way to do this? I have been searching for some time and haven't found a good way to do this. I know some photo library management software (including Picasa) does duplicate checking, but I don't really want to hand folder management over to Picasa - I tried it a few years ago and it messed with the metadata, changing file modified dates and making whole management process harder overall. If anyone knows of an Open Source photo management package which will NOT enforce its own library structure, please let me know.
Btw, Windows is my target platform.
Thanks in advance.