threaded rsync to improve performance over long distance ?

[Greg Siekas]

With the SSH-HPN you can achieve over 200MB/sec.   Depends on your latency and packet drops but you should certainly try a modified ssh/scp with rsync.   Also are you using compression with rsync -z?  That's an area that could be multi threaded.

On Jan 20, 2013, at 3:25 PM, Kevin Korb <kmk at sanitarium.net> wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> You can use the HPN enhancement patches for ssh.  They do make a big
> difference: http://www.psc.edu/index.php/hpn-ssh
> 
> On 01/20/13 18:22, Markus Moeller wrote:
>> Hi Kevin,
>> 
>> but rsync uses ssh doesn't it ?  Are there any tuning options for 
>> buffers to deal with the tcp SYN SYN-ACK delay ?
>> 
>> Thank you Markus
>> 
>> 
>> "Kevin Korb" <kmk at sanitarium.net> wrote in message 
>> news:50FC5E6F.1000509 at sanitarium.net... rsync does not use scp in
>> any way.
>> 
>> On 01/20/13 14:47, Markus Moeller wrote:
>>>>> I try to rsync a lot of data over a long distance AU to UK
>>>>> and get a slow data rate because of the known slow scp
>>>>> performance over long distances. Would it be possible with
>>>>> rsync to run multiple scp process at the same time ?
>>>>> 
>>>>> Thank you Markus
>>>>> 
>>>>> 
>> 
>>> -- Please use reply-all for most replies to avoid omitting the
>>> mailing list. To unsubscribe or change options: 
>>> https://lists.samba.org/mailman/listinfo/rsync Before posting,
>>> read: http://www.catb.org/~esr/faqs/smart-questions.html
>>> 
>> 
>> 
> 
> - -- 
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
>    Kevin Korb            Phone:    (407) 252-6853
>    Systems Administrator        Internet:
>    FutureQuest, Inc.        Kevin at FutureQuest.net  (work)
>    Orlando, Florida        kmk at sanitarium.net (personal)
>    Web page:            http://www.sanitarium.net/
>    PGP public key available on web site.
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.19 (GNU/Linux)
> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
> 
> iEYEARECAAYFAlD8fOkACgkQVKC1jlbQAQcqTwCeMsxo3MMyfFx3omGpIu5ELDuM
> V64AoLdq5ak55CPIIjVk7AHK6U+0XTbN
> =pu+/
> -----END PGP SIGNATURE-----
> -- 
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html