Low performance
Ing. Rainer Pietsch
rp.rsync at pcs-at.com
Fri Jan 6 00:11:31 MST 2012
Am 04.01.2012 16:24, schrieb Donald Pearson:
> Perhaps it's time to look at a pcap of the rsync transfer. Throughput
> is in the aggregate over time, I've seen instances where there are
> excessively long delays between packets causing a low overall throughput.
Ok, verry good idea!
I try this and post the results.
>
> On Wed, Jan 4, 2012 at 5:06 AM, Rainer Pietsch <rp.rsync at pcs-at.com
> <mailto:rp.rsync at pcs-at.com>> wrote:
>
>
>
> Am 04.01.2012 10:46, schrieb Hendrik Visage:
> > On Tue, Jan 3, 2012 at 3:42 PM, R. Pietsch <rp.rsync at pcs-at.com
> <mailto:rp.rsync at pcs-at.com>> wrote:
> >> Hi!
> >>
> >> I do a rsync between 2 machines. The throughput is only 2
> MByte/Sec.
> >>
> >> Each machine is a Supermicro server with
> >> 2 x 8 Core Opteron 6128
> >> 64 GByte of ECC RAM
> >> 1 LSI MegaRAID SAS 9280-24i4e
> >> 24 x 2TByte SATA Disks as a RAID6
> >> 2 Intel Corporation 82599EB 10-Gigabit SFI/SFP+ Network-cards
> >>
> >> Both run Ubuntu 11.04 64Bit.
> >> Both use rsync version 3.0.7 protocol version 30
> >>
> >> There are no errors reported.
> >> The local read and write rate to the disks is 1,1 GB/s.
> >> A network test shows 800MByte/s over the direct coupled
> network-cards.
> >> The CPU-usage is 5 to 7% of one core.
> >> Memory-usage is 1703 out of 64557MB.
> >> There are no other jobs running on the two machines.
> >> The LSI controllers both say: State: Optimal
> >>
> >>
> >> machine A has a rsync-daemon with the following configuration:
> >> ----------
> >> read only = false
> >> use chroot = false
> >> hosts allow = 10.99.11.0/24 <http://10.99.11.0/24>
> >> [Daten1]
> >> path = /var/daten1
> >> use chroot = yes
> >> read only = yes
> >> list = yes
> >> uid = root
> >> gid = root
> >> strict modes = yes
> >> ignore errors = no
> >> ignore nonreadable = yes
> >> transfer logging = no
> >> timeout = 600
> >> refuse options = checksum dry-run
> >> dont compress = *
> >> ----------
> >>
> >> machine B runs:
> >>
> >> /usr/bin/rsync -ax --numeric-ids --delete --delete-excluded \
> >> --exclude-from=/Backup/RB_None.excl \
> >> --link-dest=/Backup/Base/xxxxx \
> >> rsync://root@10.99.11.11/Daten1/
> <http://root@10.99.11.11/Daten1/> \
> >> /Backup/Base/yyyyyyy \
> >> --no-c --no-z
> >>
> >> The files are all about 8 MB in size.
> >>
> >> 8302592 100% 1.98MB/s 0:00:04 (xfer#861,
> to-check=51173/94679)
> >>
> >> The same - slow - transfer happens at 1GB and 5GB files.
> >>
> >>
> >> Any ideas what can cause this slow transmission?
> >
> > You do have jumbo frames enabled on both servers and the network
> > equipment in between?
> >
> > Do check the TCP/IP stack parameters, as most bandwidth testing is
> > done with UDP.
> Jumbo frames are NOT enabled - (they cause trouble with samba) and the
> test is done with netperf and tcp.
> The result is
> -----------------------
> TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.99.11.11
> (10.99.11.11) port 0 AF_INET : demo
> Recv Send Send
> Socket Socket Message Elapsed
> Size Size Size Time Throughput
> bytes bytes bytes secs. 10^6bits/sec
>
> 87380 16384 16384 10.00 7300.70
>
> -----------------------
> So we get 7.3 GBit with a tcp-stream - rawly 800MByte/sec
>
>
> --
> Mit freundlichen Grüßen / best regards
>
> Ing. Rainer Pietsch
> ----------------------------------------------------------
> PCS - Pichler Computer Systeme
> Inh. Claudia Pichler-Pietsch
> Hauptplatz 10
> A-2751 Steinabrückl
> Österreich / Austria
> ----------------------------------------------------------
> mail: r.pietsch at pcs-at.com <mailto:r.pietsch at pcs-at.com>
> web: http://www.pcs-at.com
> tel.: +43 (2622) 420 19 / 15
> <tel:%2B43%20%282622%29%20420%2019%20%2F%2015>
> mobil: +43 (676) 31 242 69 <tel:%2B43%20%28676%29%2031%20242%2069>
> fax: +43 (2622) 420 19 / 20
> <tel:%2B43%20%282622%29%20420%2019%20%2F%2020>
> ----------------------------------------------------------
>
> --
> Please use reply-all for most replies to avoid omitting the
> mailing list.
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read:
> http://www.catb.org/~esr/faqs/smart-questions.html
> <http://www.catb.org/%7Eesr/faqs/smart-questions.html>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/rsync/attachments/20120106/14cd5c92/attachment.html>
More information about the rsync
mailing list