Duplicates Searching

Please check the FAQ (https://www.xyplorer.com/faq.php) before posting a question...
Post Reply
sl23
Posts: 285
Joined: 03 Feb 2015 23:34
Location: XYplorer 64 Latest beta, Win11x64 25H2, 1920x1080 @100%

Duplicates Searching

Post by sl23 »

I have a question regarding searching for duplicate files. Specifically, I have several thousand *.fxb files, which are used for saving banks of presets for Sylenth1. Where there are so many, I've extracted all the presets from their banks, renamed for easier legibility and am now trying to remove as many duplicates as possible.

I successfully used XYplorers dupe search facility, which narrowed things down considerably, however, I am now finding there are many hundreds of duplicates still remaining that are not being picked up by this search. I have tried all the different Content types, I started with SHA-1, unsure what they are but that worked well. The others don't pick anything up, but unchecking the Contents box yields several thousand duplicates, but as a great many are just duplicate names, they are actually different presets.

So my question is about refining this search. What is the best way to tackle this? Does anybody have any ideas? I've never done this type of thing before so it's quite new to me.

Appreciate any help, thank you.

highend
Posts: 14925
Joined: 06 Feb 2011 00:33
Location: Win Server 2022 @100%

Re: Duplicates Searching

Post by highend »

If they don't have the same checksum, they are not identical files...
One of my scripts helped you out? Please donate via Paypal

sl23
Posts: 285
Joined: 03 Feb 2015 23:34
Location: XYplorer 64 Latest beta, Win11x64 25H2, 1920x1080 @100%

Re: Duplicates Searching

Post by sl23 »

Thanks for your reply.
So, even though they sound the same as a preset, they may still differ as a file? Is there any other way to check or would that require dedicated software?

EDIT: Would a text editor comparison work? Or does the fact that the checksum differs mean that won't work? Just been reading about checksums :D

highend
Posts: 14925
Joined: 06 Feb 2011 00:33
Location: Win Server 2022 @100%

Re: Duplicates Searching

Post by highend »

Just look into one to see if they are text based (or binary)?

Again: Not the same checksum = Files are NOT identical
One of my scripts helped you out? Please donate via Paypal

Norn
Posts: 504
Joined: 24 Oct 2021 16:10

Re: Duplicates Searching

Post by Norn »

You can try Duplicate Cleaner, able to export duplicate groups, and open with XY's paper folder feature, for processing.
Duplicate Cleaner.png
Export.png
To see the attached files, you need to log into the forum.
Windows 11 24H2 @100% 2560x1440

sl23
Posts: 285
Joined: 03 Feb 2015 23:34
Location: XYplorer 64 Latest beta, Win11x64 25H2, 1920x1080 @100%

Re: Duplicates Searching

Post by sl23 »

highend wrote: 17 May 2023 19:31 Just look into one to see if they are text based (or binary)?

Again: Not the same checksum = Files are NOT identical
Yeah I guessed that, but they still sound very much like! Perhaps it's just a minor volume difference or something?!

I don't think it's binary, or text, looks more like Hex?
Image 003.png
Same file...
Image 002.png
To see the attached files, you need to log into the forum.

sl23
Posts: 285
Joined: 03 Feb 2015 23:34
Location: XYplorer 64 Latest beta, Win11x64 25H2, 1920x1080 @100%

Re: Duplicates Searching

Post by sl23 »

Thanks for the tip about duplicate files cleaner. Does this app auto clean or can you go through one by one to check as you go?

Norn
Posts: 504
Joined: 24 Oct 2021 16:10

Re: Duplicates Searching

Post by Norn »

There are many options.
If it is the same file name, you can sort it in XY, maybe more convenient, you can use the label to distinguish, etc. . .
To see the attached files, you need to log into the forum.
Windows 11 24H2 @100% 2560x1440

sl23
Posts: 285
Joined: 03 Feb 2015 23:34
Location: XYplorer 64 Latest beta, Win11x64 25H2, 1920x1080 @100%

Re: Duplicates Searching

Post by sl23 »

But... not free! This is a one time only thing, so not really worth me paying for. Thanks anyway. :tup:

highend
Posts: 14925
Joined: 06 Feb 2011 00:33
Location: Win Server 2022 @100%

Re: Duplicates Searching

Post by highend »

Binary files...
One of my scripts helped you out? Please donate via Paypal

sl23
Posts: 285
Joined: 03 Feb 2015 23:34
Location: XYplorer 64 Latest beta, Win11x64 25H2, 1920x1080 @100%

Re: Duplicates Searching

Post by sl23 »

Ah ok. Thanks. I just realised, I did another search in XY but turned off the name and kept the content checked. That made a difference!!! :oops:
Sorry, I'm new to this search and compare thing! :whistle:

Post Reply