Rough Image Hash

Features wanted...
admin
Site Admin
Posts: 60558
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Rough Image Hash

Post by admin »

BTW, I'm currently working on something I internally call "Rough Image Hash". It should make identifying similar images near-automatic or at least very easy. And it will be scale-invariant, brightness-invariant, saturation-invariant, hue-tolerant, and, of course, blindingly fast. So you will be able to find "Image Dupes", and you'll get "Perceptual Sorting" in the file list. :cup:

klownboy
Posts: 4139
Joined: 28 Feb 2012 19:27

Re: Rough Image Hash

Post by klownboy »

Sounds interesting. So how would it handle simple changes to aspect ratio or rotation? Typically after getting home from a trip, I'll spend some time manipulating photos a bit. Nothing dramatic - just some minor rotation if I had a horizon tilted (which also results in some cropping) or cropping photos from a camera 4:3 to 16:9. In some instances I may lighten or darken slightly but very rarely.
Windows 11, 23H2 Build 22631.3447 at 100% 2560x1440

Marco
Posts: 2347
Joined: 27 Jun 2011 15:20

Re: Rough Image Hash

Post by Marco »

admin wrote: 26 Jan 2020 12:56 BTW, I'm currently working on something I internally call "Rough Image Hash". It should make identifying similar images near-automatic or at least very easy. And it will be scale-invariant, brightness-invariant, saturation-invariant, hue-tolerant, and, of course, blindingly fast. So you will be able to find "Image Dupes", and you'll get "Perceptual Sorting" in the file list. :cup:
Wow, AI wetness!!! :mrgreen:
Jokes aside, that's an uber-welcome feature. Sometimes I really need to find image dupes and have to resort to a third party, now defunct, utility. Glad to see that coming!
Last edited by Marco on 26 Jan 2020 15:41, edited 1 time in total.
Tag Backup - SimpleUpdater - XYplorer Messenger - The Unofficial XYplorer Archive - Everything in XYplorer
Don sees all [cit. from viewtopic.php?p=124094#p124094]

admin
Site Admin
Posts: 60558
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: Rough Image Hash

Post by admin »

klownboy wrote: 26 Jan 2020 14:20 Sounds interesting. So how would it handle simple changes to aspect ratio or rotation? Typically after getting home from a trip, I'll spend some time manipulating photos a bit. Nothing dramatic - just some minor rotation if I had a horizon tilted (which also results in some cropping) or cropping photos from a camera 4:3 to 16:9. In some instances I may lighten or darken slightly but very rarely.
We'll see. It won't be learning, but I'll be learning...

admin
Site Admin
Posts: 60558
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: Rough Image Hash

Post by admin »

Ok, I'm learning... :) Looks like it's a *little* harder than I thought initially and I'm not sure yet if that *little* is ironic. But I'm still optimistic... :cup:

jupe
Posts: 2794
Joined: 20 Oct 2017 21:14
Location: Win10 22H2 120dpi

Re: Rough Image Hash

Post by jupe »

What formats does this actually support Don, or what criteria is used to decide?, I couldn't ascertain because those I have codecs for like WebP don't work for me, whereas HEIF does though, so is it based on codec support or a fixed list of extensions?. Also, it's just a suggestion, I think it would be good to open Tolerance up to quicksearch if it's not too difficult, maybe something like #image.hash: 4 == 18cde751667618ce

admin
Site Admin
Posts: 60558
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: Rough Image Hash

Post by admin »

"WebP don't work for me"... no hash is generated?

WebP does work for me. There are no limitations AFAIK. All images that can be shown should be hashable.

jupe
Posts: 2794
Joined: 20 Oct 2017 21:14
Location: Win10 22H2 120dpi

Re: Rough Image Hash

Post by jupe »

Hmm not what I experience.
2023-07-24_020707.png
2023-07-24_020707.png (19.51 KiB) Viewed 482 times

admin
Site Admin
Posts: 60558
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: Rough Image Hash

Post by admin »

All those file types have thumbnails and hover box?

jupe
Posts: 2794
Joined: 20 Oct 2017 21:14
Location: Win10 22H2 120dpi

Re: Rough Image Hash

Post by jupe »

Yes.
I think for some filetypes the issue is x64 related, even though for WebP I have x86 plugin installed too.

admin
Site Admin
Posts: 60558
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: Rough Image Hash

Post by admin »

Ah yes, that might be. 64-bit thumbnails are currently not supported by the image hash.

Nevertheless, I worked on it a bit and the next beta might give other results.

jupe
Posts: 2794
Joined: 20 Oct 2017 21:14
Location: Win10 22H2 120dpi

Re: Rough Image Hash

Post by jupe »

It seems to be generating more hashes but all the items get duplicated with ImageHash suffix filenames of non existent files, and it doesn't complete, so its hard to tell.

2023-07-24_032801.png
2023-07-24_032801.png (85.24 KiB) Viewed 460 times

admin
Site Admin
Posts: 60558
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: Rough Image Hash

Post by admin »

Fuck, forgot to remove a line of debug code. Wait...

admin
Site Admin
Posts: 60558
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: Rough Image Hash

Post by admin »

Okay, download v24.60.0118 again.

jupe
Posts: 2794
Joined: 20 Oct 2017 21:14
Location: Win10 22H2 120dpi

Re: Rough Image Hash

Post by jupe »

Yep WebP are working now, not sure the factors at play regarding the others that still don't though.

Post Reply