Rsyncing huge file, timeout on rsyncd

Libor Klepáč libor.klepac at bcom.cz
Thu Aug 2 05:31:26 MDT 2012


Ok, i'l try setting timeout, but according to documentation, default is 
timeout=0 which means no timeout.

Maybe setting --contimeout to some large value should help?

Libor


Dne Thursday 02 August 2012 07:03:51, Tony Abernethy napsal(a):

            --timeout=SECONDS       set I/O timeout in seconds
I think this timeout must be set big enough so that data actually gets 
transferred during the window.
Having the target verify that nothing has changed yet seems to not qualify as 
resetting the timeout.
Figure on enough time so that the target can read the entire target file.
(Most likely there is a wee bit of change at the very end of the files)
 
From: rsync-bounces at lists.samba.org [mailto:rsync-bounces at lists.samba.org] On 
Behalf Of Libor Klepác
Sent: Thursday, August 02, 2012 5:47 AM
To: rsync at lists.samba.org
Subject: Re: Rsyncing huge file, timeout on rsyncd
 
Just to clarify
When using rsyncd script, there is also no progress from beginning, it just 
timeouts

Libor

Dne Thursday 02 August 2012 12:26:13, Libor Klepáč napsal(a):
> Hello,
> let me describe my setup.
> Source server is debian wheezy, rsync 3.0.9
> Destination is qnap TS-410, with rsyncd enabled, rsync 3.0.7
> 
> I'm trying to rsync two files, which are exported from source server as
> iscsi targets (windows iscsi backups). Files are on btrfs, so I use
> snapshots during rsync, so files don't change.
> One file is 50GB, second is 550GB in size.
> 
> Initial sync over rsyncd daemon went fine.
> Now, i'm trying to sync data, after change.
> 
> When i try to sync over rsyncd, it ends after 20 minutes with:
> 
> rsync: connection unexpectedly closed (2438836 bytes received so far)
> [sender] rsync error: error in rsync protocol data stream (code 12) at
> io.c(605) [sender=3.0.9]
> 
> 
> When i try to rsync over ssh, it takes ages to show progress status (around
> 1 hour for smaller file, 4-5 hours for big file).
> Whats going out there?
> Source server is idle during this "no progress" period, destination Qnap has
> one rsync process eating cpu.
> 
> My commands are (example with one file)
> for rsyncd
> rsync --inplace --progress --numeric-ids --times --password-file .passwd
> iscsi/iscsiDisk1 rsync://backup-rsync@192.168.5.250:/iSCSI-backup/iscsiDisk1
> 
> for ssh
> rsync --inplace --progress --numeric-ids --times iscsi/iscsiDisk1
> admin at 192.168.5.250:/share/MD0_DATA/iSCSI-backup/iscsiDisk1
> 
> With regards
> Libor Klepac


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/rsync/attachments/20120802/961a0642/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 836 bytes
Desc: This is a digitally signed message part.
URL: <http://lists.samba.org/pipermail/rsync/attachments/20120802/961a0642/attachment.pgp>


More information about the rsync mailing list