Page 1 of 1

Duplicates Searching

Posted: 17 May 2023 18:40
by sl23
I have a question regarding searching for duplicate files. Specifically, I have several thousand *.fxb files, which are used for saving banks of presets for Sylenth1. Where there are so many, I've extracted all the presets from their banks, renamed for easier legibility and am now trying to remove as many duplicates as possible.

I successfully used XYplorers dupe search facility, which narrowed things down considerably, however, I am now finding there are many hundreds of duplicates still remaining that are not being picked up by this search. I have tried all the different Content types, I started with SHA-1, unsure what they are but that worked well. The others don't pick anything up, but unchecking the Contents box yields several thousand duplicates, but as a great many are just duplicate names, they are actually different presets.

So my question is about refining this search. What is the best way to tackle this? Does anybody have any ideas? I've never done this type of thing before so it's quite new to me.

Appreciate any help, thank you.

Re: Duplicates Searching

Posted: 17 May 2023 19:08
by highend
If they don't have the same checksum, they are not identical files...

Re: Duplicates Searching

Posted: 17 May 2023 19:10
by sl23
Thanks for your reply.
So, even though they sound the same as a preset, they may still differ as a file? Is there any other way to check or would that require dedicated software?

EDIT: Would a text editor comparison work? Or does the fact that the checksum differs mean that won't work? Just been reading about checksums :D

Re: Duplicates Searching

Posted: 17 May 2023 19:31
by highend
Just look into one to see if they are text based (or binary)?

Again: Not the same checksum = Files are NOT identical

Re: Duplicates Searching

Posted: 17 May 2023 20:09
by Norn
You can try Duplicate Cleaner, able to export duplicate groups, and open with XY's paper folder feature, for processing.
Duplicate Cleaner.png
Export.png

Re: Duplicates Searching

Posted: 17 May 2023 21:17
by sl23
highend wrote: 17 May 2023 19:31 Just look into one to see if they are text based (or binary)?

Again: Not the same checksum = Files are NOT identical
Yeah I guessed that, but they still sound very much like! Perhaps it's just a minor volume difference or something?!

I don't think it's binary, or text, looks more like Hex?
Image 003.png
Same file...
Image 002.png

Re: Duplicates Searching

Posted: 17 May 2023 21:24
by sl23
Thanks for the tip about duplicate files cleaner. Does this app auto clean or can you go through one by one to check as you go?

Re: Duplicates Searching

Posted: 17 May 2023 21:38
by Norn
There are many options.
If it is the same file name, you can sort it in XY, maybe more convenient, you can use the label to distinguish, etc. . .

Re: Duplicates Searching

Posted: 17 May 2023 21:57
by sl23
But... not free! This is a one time only thing, so not really worth me paying for. Thanks anyway. :tup:

Re: Duplicates Searching

Posted: 17 May 2023 22:43
by highend
Binary files...

Re: Duplicates Searching

Posted: 17 May 2023 22:50
by sl23
Ah ok. Thanks. I just realised, I did another search in XY but turned off the name and kept the content checked. That made a difference!!! :oops:
Sorry, I'm new to this search and compare thing! :whistle: