Comparison of huge files ineffective?

Heiko Schlittermann hs at schlittermann.de
Wed Mar 14 13:25:39 UTC 2018


Hi,


how does rsync work if it compares two very huge files on two distinct
hosts (rsync uses a networked connection, via SSH)?

Some observation seems to indicate, that rsync first reads (and
checksums?) the remote (destination) side, then, if finished, it reads
(and checksums?) the local (source) side and then starts transferring
the delta if done with the comparison of these two files on both sides.

The major problem (with respect to runtime) seems to be the missing
parellism in read (and checksumming) the source and the destination.

1)  Is this observation right?
1a) Does it depend on the rsync version?

2)  Is there a way to get read (and checksumming) of both sides
    in parallel?


    Best regards from Dresden/Germany
    Viele Grüße aus Dresden
    Heiko Schlittermann
-- 
 SCHLITTERMANN.de ---------------------------- internet & unix support -
 Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} -
 gnupg encrypted messages are welcome --------------- key ID: F69376CE -
 ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 488 bytes
Desc: not available
URL: <http://lists.samba.org/pipermail/rsync/attachments/20180314/f1dac4bb/signature.sig>


More information about the rsync mailing list