retransfer fail of large files with inplace and broken pipe

tom raschel raschel at edvantice.de
Sun Dec 13 00:21:17 MST 2009


Hi,

i have to tranfer large files each 5-100 GB (mo-fri) over dsl line. 
unfortunately dsl lines are often not very stable and i got a broken pipe error.
(dsl lines are getting a new ip if they are broken or at least after a 
reconnect every 24 hours)

i had a script which detect the rsync error and restart the transmission.
this means that if a file has transfered e.g. 80 % i start again from beginning.

using partial and partial-dir was no solution to resync because rsync cut the 
original file (e.g. from 20 GB to 15 GB) which means that i have to transfer 
the whole rest of 5 GB.

so i had a look at --inplace which I thougt could do the trick, but inplace is 
updating the timestamp and if the script start a retransfer after a broken pipe
it fails because the --inplace file is newer than the original file of the 
sender.

using ignore-times could be a solution but slow down the whole process to much.

is there a option to tell rsync not to change the time of a --inplace 
transfered file, or maybe preserve the mtime and do a comparison of mtime 
instead of ctime.

Thx
Tom





More information about the rsync mailing list