Transferring large amount of files w/ Rsync - Initial transfer

[israel Gold]

Wayne, thank you for the reply.
Your answer conflicts with a previous answer to 'd c' on the same
problem.
How can I generate the hash data on the remote site prior to running the
incremental rsync ?

On Mon, Jan 03, 2005 at 04:40:03PM -0800, d c wrote:
> The source files have slightly changed and I now am trying to sync
> them. However, it seems that rsync has to copy the entire file
> itself the first time inorder to build the index (hash) needed in
> order to have more efficient transfers in the future.

Wayne's answer
>>The hash is determined at runtime. Rsync needs to read the whole file
>>on the receiving side (to generate the hash), the sender then uses
that
>hash data to send any unmatched data (by reading its version of the
>>file), and then the receiving side creates a duplicate file based on
its
>>original one and the data from the sender. It then moves this new file
>>over the old one.

-- Israel.

-----Original Message-----
From: Wayne Davison [mailto:wayned at samba.org] 
Sent: Monday, January 24, 2005 10:06 AM
To: israel Gold
Cc: rsync at lists.samba.org
Subject: Re: Transferring large amount of files w/ Rsync - Initial
transfer


On Sun, Jan 23, 2005 at 12:44:28PM +0200, israel Gold wrote:
> I would like to synchronize 1TB of data between local and remote sites

> over WAN.  For the initial synchronization, I would like to transfer 
> the files from the local site to the remote site using tapes, and use 
> Rsync only for the incremental synchronization.

There's no problem with that.  Rsync doesn't care if the files are
copied over by it or by any other copy method -- it makes no difference
at all.  For maximal efficiency, make sure to preserve the modify time
for the files so that rsync will more quickly figure out which files are
identical between the two systems.

..wayne..