problems with rsync 2.6.9 and large files (up to 20GB)

Matt McCutchen matt at mattmccutchen.net
Wed Dec 12 15:15:53 GMT 2007


On Wed, 2007-12-12 at 14:28 +0100, gorka barracuda wrote:
> it seems that rsync is working and finishing but when appears the
> message that summarizes the transferred files rsync starts the backup
> again (taking a lot of time)
> 
> ....
> sent 640278263924 bytes  received 217256421 bytes  8610488.88
> bytes/sec
> total size is 783944943854  speedup is 1.22
> rsync warning: some files vanished before they could be transferred
> (code 24) at 
>  main.c(977) [sender=2.6.9]
>  2007/12/11 17:02:04 del. 0
> home/jingles/soft/sinc/bin/home/g1benjamin/timel-fre
> q.po15740 
> ....

I've never known rsync to start over like that.  Are you using a script
that runs rsync repeatedly until it exits with code 0?

> I googled for this problem and I found that there are a patch file to
> solve this problem (you can see the thread in
> http://www.mail-archive.com/rsync@lists.samba.org/msg17815.html ) but
> I can't found it.

That thread is about an optimization that makes the delta-transfer
algorithm much faster on large files.  The optimization is included in
current development versions of rsync 3.0.0.  This probably is not
related to the problem with rsync starting over.

Matt



More information about the rsync mailing list