<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 12 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"DejaVu Sans";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> --timeout=SECONDS set I/O timeout in seconds<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>I think this timeout must be set big enough so that data actually gets transferred during the window.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Having the target verify that nothing has changed yet seems to not qualify as resetting the timeout.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Figure on enough time so that the target can read the entire target file.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>(Most likely there is a wee bit of change at the very end of the files)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div style='border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt'><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> rsync-bounces@lists.samba.org [mailto:rsync-bounces@lists.samba.org] <b>On Behalf Of </b>Libor Klepác<br><b>Sent:</b> Thursday, August 02, 2012 5:47 AM<br><b>To:</b> rsync@lists.samba.org<br><b>Subject:</b> Re: Rsyncing huge file, timeout on rsyncd<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p style='margin:0in;margin-bottom:.0001pt'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>Just to clarify<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>When using rsyncd script, there is also no progress from beginning, it just timeouts<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-paragraph-type:empty;-qt-block-indent:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>Libor<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'><br>Dne Thursday 02 August 2012 12:26:13, Libor Klepáč napsal(a):<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> Hello,<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> let me describe my setup.<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> Source server is debian wheezy, rsync 3.0.9<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> Destination is qnap TS-410, with rsyncd enabled, rsync 3.0.7<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> I'm trying to rsync two files, which are exported from source server as<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> iscsi targets (windows iscsi backups). Files are on btrfs, so I use<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> snapshots during rsync, so files don't change.<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> One file is 50GB, second is 550GB in size.<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> Initial sync over rsyncd daemon went fine.<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> Now, i'm trying to sync data, after change.<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> When i try to sync over rsyncd, it ends after 20 minutes with:<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> rsync: connection unexpectedly closed (2438836 bytes received so far)<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> [sender] rsync error: error in rsync protocol data stream (code 12) at<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> io.c(605) [sender=3.0.9]<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> When i try to rsync over ssh, it takes ages to show progress status (around<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> 1 hour for smaller file, 4-5 hours for big file).<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> Whats going out there?<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> Source server is idle during this "no progress" period, destination Qnap has<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> one rsync process eating cpu.<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> My commands are (example with one file)<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> for rsyncd<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> rsync --inplace --progress --numeric-ids --times --password-file .passwd<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> iscsi/iscsiDisk1 rsync://backup-rsync@192.168.5.250:/iSCSI-backup/iscsiDisk1<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> for ssh<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> rsync --inplace --progress --numeric-ids --times iscsi/iscsiDisk1<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <a href="mailto:admin@192.168.5.250:/share/MD0_DATA/iSCSI-backup/iscsiDisk1">admin@192.168.5.250:/share/MD0_DATA/iSCSI-backup/iscsiDisk1</a><o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> <o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> With regards<o:p></o:p></span></p><p style='margin:0in;margin-bottom:.0001pt;-qt-block-indent:0;-qt-user-state:0'><span style='font-size:9.0pt;font-family:"DejaVu Sans","serif"'>> Libor Klepac<o:p></o:p></span></p></div></div></body></html>