Program for finding duplicate pictures

kevozz

My new boss has a ton of pictures. Probably around 400,000. He's not sure which pictures have been backed up, with the possibility of multiple backups.

Anyone have experience with a program to find duplicate pictures? The ones I've tried just choke. It would be nice if we were able to search multiple drives.

Thanks.

tiersten

I don't know of any specific program but you can kludge something together by generating a hash value for all the files and see if there any dupes. It won't be speedy though at least initially. Once you've generated your massive hash value list then it'll be fast and easy to maintain.

Devilsbane

I don't know an all in one program, but you could use Karenware's power hasher to create an md5 hash of all of the files in each directory. Then export the lists and use the Match function in excel to Find out which ones aren't in both lists.

http://www.karenware.com/powertools/pthasher.asp

gosh1976

There's definitely a free program out there that will do it because I recently used it to search my song & pic files and delete the duplicates. It worked perfectly though it did take a long time. I wish I could tell you which program I used unfortunately I deleted it after I used it!

I don't think either of these two are what I used but you could give them a try. Free programs find and remove duplicate files | Workers' Edge - CNET News

kevozz

Thanks for the replies. I'll do some more research.

wd40

I used "Duplicate Cleaner" to clean the picture duplicates on my PC.

Duplicate Cleaner - Find Duplicate Files

it is a nice program.

FrankTh

Hi kevozz.

Maybe this freeware would be of help:

Duplicate File Finder download and reviews from SnapFiles

there is also glary utilites free version but more tricky.
Hope this can help. Good success with this task.

FrankTh

binaryman

Hi Kevozz

I recommend Directory Report
http://www.file-utilities.com

It can easily handle your 400,000 images
It can find duplicates based on the same name, size, CRC32 and/or comparing byte-by-byte
It cannot find similar photos