how to migrate 40T data and 180M files

Sven Hartrumpf Sven.Hartrumpf at FernUni-Hagen.de
Tue Aug 11 02:23:01 MDT 2009


Hi.

Tue, 11 Aug 2009 16:14:33 +0800, gaomingcn wrote:
> The second question is about memory.
> How much memory should I install to the linux box? The rsync FAQ
> (http://rsync.samba.org/FAQ.html#4) says one file will use 100 bytes
> to store relevant information, so 180M files will use about
> 18G memory.

That is true of rsync 2.
rsync 3 uses an incremental mode that allows to transfer millions of files
with 1 GB RAM or less.

Sven


More information about the rsync mailing list