So, as any craftsman would do, I put my own skills to the test and wrote a program. This software would compile a list of all the images files I have, generate a comprehensive structure in which to store the files, and eliminate all duplicates (including JPG versions of RAW files). It would also convert all my (proprietary Nikon) RAW files to (open) Adobe DNG format, and embed pertinent IPTC data (creator, copyright, etc.) into each image as well.

It took me the better part of the week to do it but finally the software - Photo Organizer Lite - was finished. (I scrapped the previous two incarnations - Photo Organizer and Photo Organizer Basic, as they were really too ambitious for the task at hand.) It's actually still running as I write this, but the most critical work is complete - the photo re-organization. Of the 157,359 images the software found 89330 exact duplicates, 7260 duplicate RAW files (where a DNG had already been created), and 29228 duplicate JPGs (where a RAW version already existed).
The happy result is a sensible organization of only about 32,000 unique images (I'll have an exact number when it's complete). I've just freed up almost 350GB of space and I can now confidently find any picture I'm looking for (presuming that I know approximately when it was taken). The next step will be to tag all my images with appropriate keywords (see The Daunting Task) so that my photos will not only be organized, but easily searchable. Methinks that will have to wait until the next time I have a full week off...
PS: In case you didn't catch it, the title is a reference to Chicken Run.
PPS: Oh, and special thanks to Jack who had a hand in (impeding) the development of this software.



