problems with rsync 2.6.9 and large files (up to 20GB)
Matt McCutchen
matt at mattmccutchen.net
Wed Dec 12 15:15:53 GMT 2007
On Wed, 2007-12-12 at 14:28 +0100, gorka barracuda wrote:
> it seems that rsync is working and finishing but when appears the
> message that summarizes the transferred files rsync starts the backup
> again (taking a lot of time)
>
> ....
> sent 640278263924 bytes received 217256421 bytes 8610488.88
> bytes/sec
> total size is 783944943854 speedup is 1.22
> rsync warning: some files vanished before they could be transferred
> (code 24) at
> main.c(977) [sender=2.6.9]
> 2007/12/11 17:02:04 del. 0
> home/jingles/soft/sinc/bin/home/g1benjamin/timel-fre
> q.po15740
> ....
I've never known rsync to start over like that. Are you using a script
that runs rsync repeatedly until it exits with code 0?
> I googled for this problem and I found that there are a patch file to
> solve this problem (you can see the thread in
> http://www.mail-archive.com/rsync@lists.samba.org/msg17815.html ) but
> I can't found it.
That thread is about an optimization that makes the delta-transfer
algorithm much faster on large files. The optimization is included in
current development versions of rsync 3.0.0. This probably is not
related to the problem with rsync starting over.
Matt
More information about the rsync
mailing list