memory usage in rsync 3.0.3 -- how much RAM should I have to
transfer 13 million files?
Aleksey Tsalolikhin
atsaloli.tech at gmail.com
Fri Aug 15 15:32:42 GMT 2008
To answer my own question, my rsync process has grown to 1 Gig
resident in memory and seems to be holding steady at size as it keeps
chugging along.
Boy am I glad incremental recursion has been added - thanks!! I
would never have been able to do this rsync otherwise.
Aleksey
On 8/14/08, Aleksey Tsalolikhin <atsaloli.tech at gmail.com> wrote:
> Hi. Let's say I have 10,000 files per directory. If I understood
> Wayne, rsync builds a list for all the files in the current dir, plus
> another list for the directory being read-ahead.
>
> So how much memory should rsync use, for 20,000 files?
>
> I did double-check with -v, and it says "receiving incremental file
> list" at the start of the rsync session.
>
> I've also removed the -H option.
>
> My options now are:
>
> --numeric-ids
> --perms
> --owner
> --group
> -D
> --links
> --times
> --block-size=2048
> --recursive
> -v
> --ignore-times
>
> What should I expect in terms of rsync's memory usage, please?
>
> Best,
> Aleksey
>
More information about the rsync
mailing list