<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
I'm going to be interested in the answer to this question one of
these days real soon, so I did some googling and found this blog:<br>
<br>
<a class="moz-txt-link-freetext" href="http://gergap.wordpress.com/tag/rsync/">http://gergap.wordpress.com/tag/rsync/</a><br>
<br>
He talks about eliminating ssh and just using rsyncs own protocol to
speed up the transfer. I read elsewhere that the encryption is
what's slowing it down - which makes sense to me.<br>
<br>
Disclaimer: I don't know anything about the author, the blog, rsync
or sshd other than what I read for the most part. So if someone
else comments with other solutions, they almost definitely know more
about it than I do.<br>
<br>
P.S. The author makes an appeal to developers
<meta http-equiv="content-type" content="text/html;
charset=windows-1252">
<span style="color: rgb(51, 51, 51); font-family: Tahoma, Verdana,
Arial, sans-serif; font-size: 15px; font-style: normal;
font-variant: normal; font-weight: normal; letter-spacing: normal;
line-height: 27px; orphans: auto; text-align: left; text-indent:
0px; text-transform: none; white-space: normal; widows: auto;
word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline
!important; float: none; background-color: rgb(188, 197, 193);">I
hope rsync will become more smart in the future and allows the
combination of “</span><code style="margin: 0px; padding: 0px;
border: 0px; font-weight: normal; font-style: normal; font-size:
1.1em; font-family: 'Courier New', Courier, Fixed; vertical-align:
baseline; font-variant: normal; line-height: normal; color:
rgb(51, 51, 51); letter-spacing: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: auto; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(188, 197,
193);">--inplace --sparse</code><span style="color: rgb(51, 51,
51); font-family: Tahoma, Verdana, Arial, sans-serif; font-size:
15px; font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 27px; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: auto; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important; float:
none; background-color: rgb(188, 197, 193);">” or can even
autodetect the best strategy.</span>" in regard to KVM files -
which sounds good to me. YMMV<br>
<br>
<br>
<div class="moz-cite-prefix">On 07/07/2014 01:18 PM, Adam Edgar
wrote:<br>
</div>
<blockquote
cite="mid:F5743EB7-511D-417D-BD2F-93CFC0585E94@research.att.com"
type="cite">
<pre wrap="">I am trying to transfer a group of files in whole using rsync using the —files-from option across a network with high bandwidth but relatively high latency. When I log into the remote machine I see an rsync command running like thus:
rsync --server --sender -Re.sf -B16384 --files-from=- --from0 . /
Note that I have used the -B option to increase block size but that seems to just apply to the blocks used for checksumming instead of actual network I/O. I came to this conclusion by running strace on the PIDs on both remote and local hosts. On the server side I got a stream of 4K writes on fd 1 followed by a select on that same fd :
write(1, "\275\214\357\357\22y4\237\215Z\226\331\355Z!\340\373\227\340V~\20\35C\3\337_\27\257\236\321\204"..., 4092) = 4092
select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {59, 999996})
I’d like to see if I can increase the write block size to cut down on the delay of each select to this unnamed pipe to sshd. I’m not sure if that would help speed up the transfer as the issue may be below at the sshd level (which I can’t strace as a non-root user). If anyone has experience with slowness at the ssh level please advice on which flags would allow me to speed up there.
Any help will be much appreciated.
Adam S Edgar
</pre>
</blockquote>
<br>
</body>
</html>