xyplorer hangs opening folder with lots of files

[Jerry]

tey are all named exactly like this but unique

Just to be clear, you mean each extension is unique?

[ckp]

tey are all named exactly like this but unique

Just to be clear, you mean each extension is unique?

>yes, because they all begin with a dot, but all are unknown file types to windows.

[ckp]

also, by the way, in File Explorer, the file type starts with screenshot as opposed to backgrounds in xyplorer. doubt it matters, but thought i'd note this too.

edit: ignore that. both file explorer and xyplorer show the same types. there is actually types beginning with text, screenshot, background, boxes, and a couple others. those text descriptions in the filename itself and in the extension name seem to represent which type of image they are as far as the application i use that created them goes.

[Jerry]

yes, because they all begin with a dot, but all are unknown file types to windows.

So each file has its own unique extension meaning there are some 67,000 distinct file types, right? I think we can safely infer for now that this is the heart of the problem. But we'll need Don to weigh in as to what this means to XYplorer when it reads the folder and fills the list. In the meantime, I'll be happy to try out the folder zip on my system if you can make it publicly accessible somewhere.

[ckp]

sure. it's just under 3GB zipped. still want it? i think i can share it via my dropbox pro account

[highend]

I conduct all those test in a ram disk. Just to rule out things like slow hardware (like 5,4k hdds)
I'm sorry, but in all test with 70k files (regardless if they have a file extension like you posted or not),
XYplorer and File Explorer open the folder and display it's content in nearly exactly the same
amount of time.

Download the last free version from here: https://www.hidrive.strato.com/lnk/XAjPy6IU
and test it again just to rule out that it has anything to do with your older version

I'll take the .zip file link as well once you've uploaded it...

[ckp]

I conduct all those test in a ram disk. Just to rule out things like slow hardware (like 5,4k hdds)
I'm sorry, but in all test with 70k files (regardless if they have a file extension like you posted or not),
XYplorer and File Explorer open the folder and display it's content in nearly exactly the same
amount of time.

Download the last free version from here: https://www.hidrive.strato.com/lnk/XAjPy6IU
and test it again just to rule out that it has anything to do with your older version

I'll take the .zip file link as well once you've uploaded it...

> i already noted that I tested the latest paid version (trial) and it had the same exact issue. still want me to try the latest free version?
i'll have the dropbox link to the zip shortly. i will pm it to you

[Jerry]

sure. it's just under 3GB zipped. still want it? i think i can share it via my dropbox pro account

3GB? Is that all? ;-) I have both the disk space and bandwidth to get it. Just post or PM the details.

[ckp]

i just PM'd both of you with a link. Let me know when you have it so i can delete it from my dropbox. thanks!

[ckp]

i just downloaded the zip to my win 10 x64 work pc which has a brand new SSD drive.
the same exact test took even longer , about 1min26sec. and i could not go up a level , open a file in that folder or anything during this time.
so i'm sure you will see the issue, although i don't think you should be looking for the issue with a ram disk.

[highend]

What specs (processor + ram) does the machine at work have?

[ckp]

lenovo laptop, fast high quality 512GB ssd drive. intel i7-4800MQ 2.70GHz. 32GB RAM
also, this system is still very clean as i just installed a fresh win 10 x64 on it yesterday for the new ssd drive. so it doesn't even have antivirus or other things yet to slow it down.

[highend]

Doesn't make much sense. The i7 is about 10% faster than the i5 (at it's default clock speed). So even if you overclocked the i5 to let's say 3,5 GHz it would
still only be ~10% faster than the i7 (on a single thread!). Ram isn't the issue here. The ssd is a multitude faster (especially regarding iops) than your hdd at home.
Technically the work laptop should perform on about the same level (depending on how far you overclocked your home pc) but not about 50% slower (86 to 58 seconds)...

Got the file, will do some testing...

[Jerry]

Ok, got the zip and extracted it to a regular external drive. And I see the problem you are describing -- neither ESC nor backspace reliably or quickly stopped XYplorer while it was populating the list. Furthermore, as I surmised, it IS related to the unique extensions and the tens of thousands of resulting unique file types. Because, when I appended ".cache" to all the files, making them all of file type ".cache", the problem is gone. I appended the .cache extension using Regex rename with this expression:

Code: Select all

$ > .cache

so files were changed like this:
.Boxes-c847a12c-fbbd-4d78-90d1-79e488340f26-285-380 --> .Boxes-c847a12c-fbbd-4d78-90d1-79e488340f26-285-380.cache

It actually took too long to carry out the appending of all the files, so I killed XYplorer, went back in, filtered all the .cache files that were renamed (22,590 of the total) and tried to move them to a subfolder named _tmp. But that brought up the infamous Windows green progress bar window which I knew was going to take forever also. So I aborted that, and went into a command prompt and moved the files there:

Code: Select all

move *.*.cache _tmp

Then I went into the _tmp folder with just the 22,590 .cache files and all was ok.

So I would advise that you rename these files in some similar fashion (with the same extension), while still retaining the rest of the name with the unique hexadecimal info. It serves no purpose to have them all have a unique file type, despite the fact that File Explorer seems to handle this better. Alternatively, you can filter and regex rename them with grouped extensions like say, "*.text-cache", ".background-cache", etc. You could a single regex rename on all the files to accomplish that using this expression, but you will have to be very patient until the rename is done:

Code: Select all

^\.([^-]+)-(.+) > .$1-$2.$1-cache

So this results in
.Boxes-1b7ff33c-a2a2-466e-913e-92d97af02a1e-285-380.Boxes-cache
.Screenshots-452d331a-21d1-4a06-bfa4-a8596424c46e-285-380.Screenshots-cache
etc.

[ckp]

well, the renaming solution is no good for me, because these cached files and names often change, get deleted and recreated with new names.
hoping you can fix the bug in xyplorer?