Low performance

[Ing. Rainer Pietsch]

Am 04.01.2012 16:24, schrieb Donald Pearson:
> Perhaps it's time to look at a pcap of the rsync transfer.  Throughput 
> is in the aggregate over time, I've seen instances where there are 
> excessively long delays between packets causing a low overall throughput.

Ok, verry good idea!
I try this and post the results.
>
> On Wed, Jan 4, 2012 at 5:06 AM, Rainer Pietsch <rp.rsync at pcs-at.com 
> <mailto:rp.rsync at pcs-at.com>> wrote:
>
>
>
>     Am 04.01.2012 10:46, schrieb Hendrik Visage:
>     > On Tue, Jan 3, 2012 at 3:42 PM, R. Pietsch <rp.rsync at pcs-at.com
>     <mailto:rp.rsync at pcs-at.com>> wrote:
>     >> Hi!
>     >>
>     >> I do a rsync between 2 machines. The throughput is only 2
>     MByte/Sec.
>     >>
>     >> Each machine is a Supermicro server with
>     >>    2 x 8 Core Opteron 6128
>     >>    64 GByte of ECC RAM
>     >>    1 LSI MegaRAID SAS 9280-24i4e
>     >>    24 x 2TByte SATA Disks as a RAID6
>     >>    2 Intel Corporation 82599EB 10-Gigabit SFI/SFP+ Network-cards
>     >>
>     >> Both run Ubuntu 11.04 64Bit.
>     >> Both use rsync version 3.0.7  protocol version 30
>     >>
>     >> There are no errors reported.
>     >> The local read and write rate to the disks is 1,1 GB/s.
>     >> A network test shows 800MByte/s over the direct coupled
>     network-cards.
>     >> The CPU-usage is  5 to 7% of one core.
>     >> Memory-usage is 1703 out of 64557MB.
>     >> There are no other jobs running on the two machines.
>     >> The LSI controllers both say: State: Optimal
>     >>
>     >>
>     >> machine A has a rsync-daemon with the following configuration:
>     >> ----------
>     >> read only = false
>     >> use chroot = false
>     >> hosts allow = 10.99.11.0/24 <http://10.99.11.0/24>
>     >> [Daten1]
>     >>        path = /var/daten1
>     >>        use chroot = yes
>     >>        read only = yes
>     >>        list = yes
>     >>        uid = root
>     >>        gid = root
>     >>        strict modes = yes
>     >>        ignore errors = no
>     >>        ignore nonreadable = yes
>     >>        transfer logging = no
>     >>        timeout = 600
>     >>        refuse options = checksum dry-run
>     >>        dont compress = *
>     >> ----------
>     >>
>     >> machine B runs:
>     >>
>     >> /usr/bin/rsync -ax --numeric-ids --delete --delete-excluded \
>     >>    --exclude-from=/Backup/RB_None.excl \
>     >>    --link-dest=/Backup/Base/xxxxx \
>     >>    rsync://root@10.99.11.11/Daten1/
>     <http://root@10.99.11.11/Daten1/> \
>     >>    /Backup/Base/yyyyyyy \
>     >>    --no-c --no-z
>     >>
>     >> The files are all about 8 MB in size.
>     >>
>     >>    8302592 100%    1.98MB/s    0:00:04 (xfer#861,
>     to-check=51173/94679)
>     >>
>     >> The same - slow - transfer happens at 1GB and 5GB files.
>     >>
>     >>
>     >> Any ideas what can cause this slow transmission?
>     >
>     > You do have jumbo frames enabled on both servers and the network
>     > equipment in between?
>     >
>     > Do check the TCP/IP stack parameters, as most bandwidth testing is
>     > done with UDP.
>     Jumbo frames are NOT enabled - (they cause trouble with samba) and the
>     test is done with netperf and tcp.
>     The result is
>     -----------------------
>     TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.99.11.11
>     (10.99.11.11) port 0 AF_INET : demo
>     Recv   Send    Send
>     Socket Socket  Message  Elapsed
>     Size   Size    Size     Time     Throughput
>     bytes  bytes   bytes    secs.    10^6bits/sec
>
>      87380  16384  16384    10.00    7300.70
>
>     -----------------------
>     So we get 7.3 GBit with a tcp-stream - rawly 800MByte/sec
>
>
>     --
>     Mit freundlichen Grüßen / best regards
>
>     Ing. Rainer Pietsch
>     ----------------------------------------------------------
>     PCS - Pichler Computer Systeme
>     Inh. Claudia Pichler-Pietsch
>     Hauptplatz 10
>     A-2751 Steinabrückl
>     Österreich / Austria
>     ----------------------------------------------------------
>     mail: r.pietsch at pcs-at.com <mailto:r.pietsch at pcs-at.com>
>     web: http://www.pcs-at.com
>     tel.: +43 (2622) 420 19 / 15
>     <tel:%2B43%20%282622%29%20420%2019%20%2F%2015>
>     mobil: +43 (676) 31 242 69 <tel:%2B43%20%28676%29%2031%20242%2069>
>     fax: +43 (2622) 420 19 / 20
>     <tel:%2B43%20%282622%29%20420%2019%20%2F%2020>
>     ----------------------------------------------------------
>
>     --
>     Please use reply-all for most replies to avoid omitting the
>     mailing list.
>     To unsubscribe or change options:
>     https://lists.samba.org/mailman/listinfo/rsync
>     Before posting, read:
>     http://www.catb.org/~esr/faqs/smart-questions.html
>     <http://www.catb.org/%7Eesr/faqs/smart-questions.html>
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/rsync/attachments/20120106/14cd5c92/attachment.html>