slow browsing on network drives

[mussor]

i can feel the tension here as well ))

Code: Select all

XYplorer 26.30.0405  -  Lifetime License Enterprise  -  Windows 11 Pro, 64-bit, Version 23H2, Build 22631.4112 (10.0)  -  2024-08-30 13:16:20
=============================================================================================================================================

    9.852  -  2024-08-30 13:16:14.080  L-N  slobro-bbM-IN: \\server\share\data_share\***\AutoHotKey\old\
        1  -  2024-08-30 13:16:14.081  L-N  slobro-bbMgFB-IN: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.081  L-N  slobro-bbMgFB2-IN: \\server\share\data_share\***\AutoHotKey\old\
       21  -  2024-08-30 13:16:14.102  L-N  slobro-bbMgFB2-OUT: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.102  L-N  slobro-bbMgFB2-3-Do: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.102  L-N  slobro-bbMgFB2-3-add-IN: \\server\share\data_share\***\AutoHotKey\old\AhkSpy.ahk
       20  -  2024-08-30 13:16:14.122  L-N  slobro-bbMgFB2-3-add-OUT: \\server\share\data_share\***\AutoHotKey\old\AhkSpy.ahk
        0  -  2024-08-30 13:16:14.122  L-N  slobro-bbMgFB2-3-FNF: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.122  L-N  slobro-bbMgFB2-4-Do: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.122  L-N  slobro-bbMgFB2-4-add-IN: \\server\share\data_share\***\AutoHotKey\old\AHK_ClickImage_test1.ahk
       16  -  2024-08-30 13:16:14.138  L-N  slobro-bbMgFB2-4-add-OUT: \\server\share\data_share\***\AutoHotKey\old\AHK_ClickImage_test1.ahk
        0  -  2024-08-30 13:16:14.138  L-N  slobro-bbMgFB2-4-FNF: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.138  L-N  slobro-bbMgFB2-5-Do: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.138  L-N  slobro-bbMgFB2-5-add-IN: \\server\share\data_share\***\AutoHotKey\old\AHK_Other_FMOD_PT.ahk
       19  -  2024-08-30 13:16:14.157  L-N  slobro-bbMgFB2-5-add-OUT: \\server\share\data_share\***\AutoHotKey\old\AHK_Other_FMOD_PT.ahk
        0  -  2024-08-30 13:16:14.157  L-N  slobro-bbMgFB2-5-FNF: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.157  L-N  slobro-bbMgFB2-6-Do: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.157  L-N  slobro-bbMgFB2-6-add-IN: \\server\share\data_share\***\AutoHotKey\old\FMODCopyNames_AHK.ahk
       20  -  2024-08-30 13:16:14.177  L-N  slobro-bbMgFB2-6-add-OUT: \\server\share\data_share\***\AutoHotKey\old\FMODCopyNames_AHK.ahk
        0  -  2024-08-30 13:16:14.177  L-N  slobro-bbMgFB2-6-FNF: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.177  L-N  slobro-bbMgFB2-7-Do: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.177  L-N  slobro-bbMgFB2-7-add-IN: \\server\share\data_share\***\AutoHotKey\old\GetEnabled.ahk
       20  -  2024-08-30 13:16:14.197  L-N  slobro-bbMgFB2-7-add-OUT: \\server\share\data_share\***\AutoHotKey\old\GetEnabled.ahk
        0  -  2024-08-30 13:16:14.197  L-N  slobro-bbMgFB2-7-FNF: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.197  L-N  slobro-bbMgFB2-8-Do: \\server\share\data_share\***\AutoHotKey\old\
        0  -  2024-08-30 13:16:14.197  L-N  slobro-bbMgFB2-8-add-IN: \\server\share\data_share\***\AutoHotKey\old\MasterScript.ahk
       24  -  2024-08-30 13:16:14.221  L-N  slobro-bbMgFB2-8-add-OUT: \\server\share\data_share\***\AutoHotKey\old\MasterScript.ahk
        0  -  2024-08-30 13:16:14.221  L-N  slobro-bbMgFB2-8-FNF: \\server\share\data_share\***\AutoHotKey\old\
  --------------------------------------------------------------------------------------------------
    2.778  -  2024-08-30 13:16:16.999  L-N  slobro-bbMgFB-OUT: \\server\share\data_share\***\AutoHotKey\old\
      104  -  2024-08-30 13:16:17.103  L-N  slobro-bbM-OUT: \\server\share\data_share\***\AutoHotKey\old\

[admin]

I now have a suspicion. With a bit of luck, v26.30.0406 (viewtopic.php?p=223569#p223569) will prove the culprit.

[mussor]

great, here it is

Code: Select all

XYplorer 26.30.0406  -  Lifetime License Enterprise  -  Windows 11 Pro, 64-bit, Version 23H2, Build 22631.4112 (10.0)  -  2024-08-30 15:44:42
=============================================================================================================================================

   12.151  -  2024-08-30 15:44:34.646  L-N  slobro-aFIL-gCFI-IN: \\server\share\data_share\***\AutoHotKey\old\AhkSpy.ahk
        0  -  2024-08-30 15:44:34.646  L-N  slobro-aFIL-gCFI-OUT: \\server\share\data_share\***\AutoHotKey\old\AhkSpy.ahk
        0  -  2024-08-30 15:44:34.646  L-N  slobro-aFIL-aIF-IN: \\server\share\data_share\***\AutoHotKey\old\AhkSpy.ahk
        1  -  2024-08-30 15:44:34.647  L-N  slobro-aFIL-aIF-OUT: \\server\share\data_share\***\AutoHotKey\old\AhkSpy.ahk
        0  -  2024-08-30 15:44:34.647  L-N  slobro-aFIL-Compressed-IN: \\server\share\data_share\***\AutoHotKey\old\AhkSpy.ahk
       17  -  2024-08-30 15:44:34.665  L-N  slobro-aFIL-Compressed-OUT: \\server\share\data_share\***\AutoHotKey\old\AhkSpy.ahk
        0  -  2024-08-30 15:44:34.665  L-N  slobro-aFIL-gCFI-IN: \\server\share\data_share\***\AutoHotKey\old\AHK_ClickImage_test1.ahk
        0  -  2024-08-30 15:44:34.665  L-N  slobro-aFIL-gCFI-OUT: \\server\share\data_share\***\AutoHotKey\old\AHK_ClickImage_test1.ahk
        0  -  2024-08-30 15:44:34.665  L-N  slobro-aFIL-aIF-IN: \\server\share\data_share\***\AutoHotKey\old\AHK_ClickImage_test1.ahk
        0  -  2024-08-30 15:44:34.665  L-N  slobro-aFIL-aIF-OUT: \\server\share\data_share\***\AutoHotKey\old\AHK_ClickImage_test1.ahk
        0  -  2024-08-30 15:44:34.665  L-N  slobro-aFIL-Compressed-IN: \\server\share\data_share\***\AutoHotKey\old\AHK_ClickImage_test1.ahk
       14  -  2024-08-30 15:44:34.679  L-N  slobro-aFIL-Compressed-OUT: \\server\share\data_share\***\AutoHotKey\old\AHK_ClickImage_test1.ahk
        0  -  2024-08-30 15:44:34.679  L-N  slobro-aFIL-gCFI-IN: \\server\share\data_share\***\AutoHotKey\old\AHK_Other_FMOD_PT.ahk
        0  -  2024-08-30 15:44:34.679  L-N  slobro-aFIL-gCFI-OUT: \\server\share\data_share\***\AutoHotKey\old\AHK_Other_FMOD_PT.ahk
        0  -  2024-08-30 15:44:34.679  L-N  slobro-aFIL-aIF-IN: \\server\share\data_share\***\AutoHotKey\old\AHK_Other_FMOD_PT.ahk
        0  -  2024-08-30 15:44:34.679  L-N  slobro-aFIL-aIF-OUT: \\server\share\data_share\***\AutoHotKey\old\AHK_Other_FMOD_PT.ahk
        0  -  2024-08-30 15:44:34.679  L-N  slobro-aFIL-Compressed-IN: \\server\share\data_share\***\AutoHotKey\old\AHK_Other_FMOD_PT.ahk
       17  -  2024-08-30 15:44:34.696  L-N  slobro-aFIL-Compressed-OUT: \\server\share\data_share\***\AutoHotKey\old\AHK_Other_FMOD_PT.ahk
        0  -  2024-08-30 15:44:34.696  L-N  slobro-aFIL-gCFI-IN: \\server\share\data_share\***\AutoHotKey\old\FMODCopyNames_AHK.ahk
        0  -  2024-08-30 15:44:34.696  L-N  slobro-aFIL-gCFI-OUT: \\server\share\data_share\***\AutoHotKey\old\FMODCopyNames_AHK.ahk
        0  -  2024-08-30 15:44:34.696  L-N  slobro-aFIL-aIF-IN: \\server\share\data_share\***\AutoHotKey\old\FMODCopyNames_AHK.ahk
        0  -  2024-08-30 15:44:34.696  L-N  slobro-aFIL-aIF-OUT: \\server\share\data_share\***\AutoHotKey\old\FMODCopyNames_AHK.ahk
        0  -  2024-08-30 15:44:34.696  L-N  slobro-aFIL-Compressed-IN: \\server\share\data_share\***\AutoHotKey\old\FMODCopyNames_AHK.ahk
       15  -  2024-08-30 15:44:34.711  L-N  slobro-aFIL-Compressed-OUT: \\server\share\data_share\***\AutoHotKey\old\FMODCopyNames_AHK.ahk
        0  -  2024-08-30 15:44:34.711  L-N  slobro-aFIL-gCFI-IN: \\server\share\data_share\***\AutoHotKey\old\GetEnabled.ahk
        1  -  2024-08-30 15:44:34.712  L-N  slobro-aFIL-gCFI-OUT: \\server\share\data_share\***\AutoHotKey\old\GetEnabled.ahk
        0  -  2024-08-30 15:44:34.712  L-N  slobro-aFIL-aIF-IN: \\server\share\data_share\***\AutoHotKey\old\GetEnabled.ahk
        0  -  2024-08-30 15:44:34.712  L-N  slobro-aFIL-aIF-OUT: \\server\share\data_share\***\AutoHotKey\old\GetEnabled.ahk
        0  -  2024-08-30 15:44:34.712  L-N  slobro-aFIL-Compressed-IN: \\server\share\data_share\***\AutoHotKey\old\GetEnabled.ahk
       18  -  2024-08-30 15:44:34.730  L-N  slobro-aFIL-Compressed-OUT: \\server\share\data_share\***\AutoHotKey\old\GetEnabled.ahk
        0  -  2024-08-30 15:44:34.730  L-N  slobro-aFIL-gCFI-IN: \\server\share\data_share\***\AutoHotKey\old\MasterScript.ahk
        1  -  2024-08-30 15:44:34.731  L-N  slobro-aFIL-gCFI-OUT: \\server\share\data_share\***\AutoHotKey\old\MasterScript.ahk
        0  -  2024-08-30 15:44:34.731  L-N  slobro-aFIL-aIF-IN: \\server\share\data_share\***\AutoHotKey\old\MasterScript.ahk
        0  -  2024-08-30 15:44:34.731  L-N  slobro-aFIL-aIF-OUT: \\server\share\data_share\***\AutoHotKey\old\MasterScript.ahk
        0  -  2024-08-30 15:44:34.731  L-N  slobro-aFIL-Compressed-IN: \\server\share\data_share\***\AutoHotKey\old\MasterScript.ahk
       14  -  2024-08-30 15:44:34.745  L-N  slobro-aFIL-Compressed-OUT: \\server\share\data_share\***\AutoHotKey\old\MasterScript.ahk

[admin]

Ha, that's a bingo!

Looks like your network location is on a compressed volume, and XY is polling the size on disk using the GetCompressedFileSizeW API, which is obviously bloody slow when on a network location.

The next beta should fix the slowness.

[mussor]

a ha! looking forward to it, putting some to cool down

[admin]

Already there: viewtopic.php?p=223575#p223575

[mussor]

yees!
it's fast now! great job and thank you!


Now, when we have this working great, there is one more problem that is maybe connected to this.
Anytime I copy something to network disc, browsing that same disc within duration of the copy process is very slow.
say for example that I'm copying a file to
\\server\share\a\b\c\d\a.mp4

when I try to list items in folders c,b or a it's much slower during the copy process. It is not like that in Win Explorer. When I copy with WinExplorer and browse the same location (or folders on that location) the speed is almost not affected by the copy process.
But copying a file to network location with XY and browsing it (like going to different folders) it is slow.

May this be a bit similar issue?

edit: this has been not introduced with this fix. It was like that as far as I can remember.

[admin]

Try to uncheck this: Configuration | General | Refresh, Icons, History | Auto-Refresh | Refresh during file operations

[highend]

Refresh during file operations
Maybe this could be split into a "In network locations as well" sub point?

[admin]

It should be controlled by Configuration | General | Refresh, Icons, History | Auto-Refresh | Include network locations, shouldn't it? (I'm not sure ATM whether this is the case, no time to check.)

[admin]

Checked it: Yes, unchecking "Include network locations" overrides "Refresh during file operations" (no refresh will happen during file ops).

[admin]

I assume the other victims of slow browsing are happy now, too?

[daniel_m]

Could "Respond to file system notifications" be made to ignore network drives? Auto-refresh works well with a network drive, except when "Respond to file system notifications" is enabled.

Maybe it is easier to understand what I mean by illustrating how this would look like in the settings:

1.png (32.69 KiB) Viewed 2243 times

(recessed to avoid confusion about the seemingly duplicate "Include network locations")

2.png (32.69 KiB) Viewed 2243 times

(in-line)

[admin]

Could "Respond to file system notifications" be made to ignore network drives? Auto-refresh works well with a network drive, except when "Respond to file system notifications" is enabled.

I am hearing this for the first time. Could you elaborate?

[daniel_m]

I am hearing this for the first time. Could you elaborate?

This is an issue that we discovered 3 years ago: viewtopic.php?t=23474
In v22.20.0222, you made DisableSHChangeNotifyRegister=1 from XYplorer.ini available as setting Configuration | General | Refresh, Icons, History | Auto-Refresh | Listen (Respond) to file system notifications in the UI.

Now the question is if file system notifications can be made to refresh local drives, but not network drives.