OOM on big copy

Things you’d like to miss in the future...
Post Reply
oblivion
Posts: 142
Joined: 13 Apr 2011 11:35

OOM on big copy

Post by oblivion »

So I'm migrating some data from one system to another. And I thought I'd use XYcopy's backup feature to do the job, as there's a lot of data and I want to move most of it ahead of the actual switch over and then get caught up painlessly.

When I say a lot of data, rather scarily there's 170,000 files in a single folder.

Target in right pane, select all in left pane, backup to other pane. And XYcopy claimed out of memory and crashed. It WAS running in a very old system, which might be relevant, only 4Gb RAM...

I'm using Teracopy to do it right now, which seems to be coping. So this is definitely an edge case and may not be the sort of thing that's going to cause problems for most people...
-- bests, Tim

...This space unintentionally left blank.

admin
Site Admin
Posts: 60595
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: OOM on big copy

Post by admin »

Thanks for the report, pity you did not take a snapshot of the error message, or did you?

oblivion
Posts: 142
Joined: 13 Apr 2011 11:35

Re: OOM on big copy

Post by oblivion »

admin wrote: 11 Feb 2020 16:20 Thanks for the report, pity you did not take a snapshot of the error message, or did you?
No, but I've just replicated the error. Turns out it wasn't XYCopy reporting the error, as I (probably) assumed.

It's an XYPlorer window, reporting:

Code: Select all

Error: 7 (0x00000007)
Desc: Out of memory
Dll: 0
Proc: qu_ProcessData@0

Source: XYPlorer
XY ver: XYPlorer 20.70.0000
OS: Windows 2003 Server (Service Pack 2), 32-bit, Build 3790
Locale: 2057
ANSI: 1252, ACP: 1252 (ANSI - Latin I)
Font: Segoe UI 9, DBCS: No
DPI: 96 (100%), 1920x1080

Date: 2020-02-11 16:52:51
-- bests, Tim

...This space unintentionally left blank.

admin
Site Admin
Posts: 60595
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: OOM on big copy

Post by admin »

Thanks.

I cannot fix this quickly. Meanwhile you will have to split up your task in parts. (Or use Teracopy ;))

oblivion
Posts: 142
Joined: 13 Apr 2011 11:35

Re: OOM on big copy

Post by oblivion »

For what it's worth, as an experiment (and having copied most of the files across already) I tried again from the destination machine -- better specs, 24Gb RAM and a later Windows version -- rather than the source (ie pulling rather than pushing) and used backup again. Oh, and I'd updated XYplorer to 20.80.0100 too.

It worked. But it showed "not responding" for ages before starting anything. Presumably comparing source and destination where each has >170k files stored is going to be nontrivial! :)
-- bests, Tim

...This space unintentionally left blank.

admin
Site Admin
Posts: 60595
Joined: 22 May 2004 16:48
Location: Win8.1 @100%, Win10 @100%
Contact:

Re: OOM on big copy

Post by admin »

Did you use Custom Copy? (Configuration | File Operations | File Operations | Custom Copy Operations | Use Custom Copy)

Post Reply