Finding Duplicates Against a Library?
Posted: 01 Jul 2021 00:37
Hi,
I'm trying to find duplicates against a library of files in a tree. The aim is to delete any files in the rest of the search location(s) (i.e. that which is not part of the library tree) which match those in the file library.
The problem I have is that the duplicate filter will include the following files which I don't want to delete:
- Duplicate groups where none of the files are in the library.
- Duplicate groups where all the files are in the library.
I also then have the further challenge of selecting only those files that are outside the library before hitting delete.
Is there an easy way to filter the duplicate filter results to deal with the above?
If I was programming this I'd simply create a set of checksums for the library files and then check the checksum for each of the non-library files against that list, eliminating if I found a match (I'd probably match size as well) - is there a way to do that?
In an ideal world, the dupe filter would have the option of defining the library path (which if defined would cause a duplicate group to only be valid if one of the paths in a group matched the library path) and a checkbox to exclude duplicate groups which only had files in the library path. The right click select on the dupe column would then have additional options to select all files within the library or all files outside the library.
Thoughts welcome!
I'm trying to find duplicates against a library of files in a tree. The aim is to delete any files in the rest of the search location(s) (i.e. that which is not part of the library tree) which match those in the file library.
The problem I have is that the duplicate filter will include the following files which I don't want to delete:
- Duplicate groups where none of the files are in the library.
- Duplicate groups where all the files are in the library.
I also then have the further challenge of selecting only those files that are outside the library before hitting delete.
Is there an easy way to filter the duplicate filter results to deal with the above?
If I was programming this I'd simply create a set of checksums for the library files and then check the checksum for each of the non-library files against that list, eliminating if I found a match (I'd probably match size as well) - is there a way to do that?
In an ideal world, the dupe filter would have the option of defining the library path (which if defined would cause a duplicate group to only be valid if one of the paths in a group matched the library path) and a checkbox to exclude duplicate groups which only had files in the library path. The right click select on the dupe column would then have additional options to select all files within the library or all files outside the library.
Thoughts welcome!