Page 1 of 1

OneDrive with large local folders

Posted: 09 Nov 2022 22:20
by John.JCAT
I am having quite a few "glitches" with XYPlorer when working with OneDrive folders that have large numbers of PDFs in them (like between 1 and 4 thousand), even though the folders are all defined to OneDrive to be retained on my local hard drive in addition to the OneDrive servers.

It's hard to describe all the "glitches" because I am having difficulty reproducing some of them, but this is one example that I am able to reproduce. I suspect that the issue underlying this "glitch" may be the same one causing my other problems.

This video demonstrates the "glitch"

I have 1,331 files in the folder and I am trying to find a pattern that contains "A - ".

Typing "A - " in the live filter box only filters the files containing the letter "a".

If I backspace to the "A", wait for it to filter, then add the " - " the filter works as expected

If I move the cursor back to the "A" in the filter box, backspace it out and replace it with the letter "B" the filter only shows files that contain the string " - "

Again, if I backspace to the letter "B", wait for the filter to complete, then add the " -" the filter works as expected

When I clear the filter it takes an unreasonably long time for the list of files to draw, considering that the files are located on my local fast solid state disk.

I hope this video will help you understand what is happening and find a resultion to the problem.

Here is a link to the video on YouTube:

https://youtu.be/AiMpnaEY9tk

Re: OneDrive with large local folders

Posted: 09 Nov 2022 22:26
by highend
Just a question: When you copy that folder to a different place on the same ssd, that is NOT inside your dropbox folder, does the same problem occur when you use the live filter in that directory?

Re: OneDrive with large local folders

Posted: 09 Nov 2022 23:30
by John.JCAT
I just now did that, and, yes I get the exact same issue. Looks like OneDrive is not involved. Hopefully that helps.

Re: OneDrive with large local folders

Posted: 10 Nov 2022 13:53
by John.JCAT
I am not trying to add pressure to this issue, but just so you know that this issue is not limited to one folder in my library, I get this problem on many of my folders. I have folders containing the following numbers of files:
465
527
422
423
1383
1655
1331
1310
298
1500
1558
3354
3397
805
654
3750
1939
1560
1540

So you see why I love having XYPlorer to help me manage these numbers of files.

Re: OneDrive with large local folders

Posted: 10 Nov 2022 14:38
by highend
I don't have the time to test that with real files, so I just created 1500 files (.pdf) with 1024 kb content each.

Show your settings as well, please.
This page: Configuration - Find and Filter - Filters & Type Ahead Find

Whatever I insert into the LFB, filtering on these number of files is... Instant. No delays at all.

So, apart from your problem what is shown or not on modifying the LFB content: Is XYplorer.exe (or it's folder) excluded in your antivirus solution?
And yes, Windows Defender is one of them and supports exclusions :)

Re: OneDrive with large local folders

Posted: 10 Nov 2022 19:12
by John.JCAT
Here are my Configuration settings and MalWareBytes exclusion list.
2022-11-10_13-06-44.png
2022-11-10_13-06-44.png (40.8 KiB) Viewed 1501 times
2022-11-10_12-42-10.png
2022-11-10_12-42-10.png (77.33 KiB) Viewed 1501 times

Re: OneDrive with large local folders

Posted: 10 Nov 2022 19:28
by John.JCAT
I did a little testing, and on my SSD file counts over about 500 encounter the problems, 400 is almost instant on Live Filter.

Re: OneDrive with large local folders

Posted: 11 Nov 2022 02:18
by RalphM
You should exclude the whole XY folder from your AV as there are other helper exe's present.

Re: OneDrive with large local folders

Posted: 11 Nov 2022 11:55
by Horst
Using Microsoft Defender its better as you can not only set folder trees to exclude but also processes.
May be Malwarebytes has a similar option.

Re: OneDrive with large local folders

Posted: 11 Nov 2022 14:31
by John.JCAT
I did some more testing...Changed the file type from .PDF to .TXT and the problem goes away. So the "glitch" appears to be related to the fact that all of the files I am working with here are music charts in PDF format.

Re: OneDrive with large local folders

Posted: 11 Nov 2022 15:25
by highend
Preview pane open?

If not, what happens (when doing it with the .pdf files) if you hide the "size on disk" and "folderpath" columns?

Re: OneDrive with large local folders

Posted: 11 Nov 2022 15:55
by John.JCAT
You got it! It's the "Folder Path" column. I turn it off and the problem goes away.

Re: OneDrive with large local folders

Posted: 19 Nov 2022 19:04
by John.JCAT
I Created a short video to demonstrate the difference between the live filter of a large folder with and without the "Folder Path" column in the view.
Hope this helps understand the issue. I have changed my column views to eliminate the "Folder Path" column except when I need it for data extraction, so the problem is no longer causing an issue for me, but other people may not be aware of the issue.

Here's the link to the video on YouTube: https://youtu.be/oA5iFbw1OVI.

Re: OneDrive with large local folders

Posted: 20 Nov 2022 10:55
by admin
"Folder Path" is a shell property. They are slow.