rsync takes long pauses in xfer ?

[Kevin Korb]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

- --itemize-changes

On 06/12/12 10:08, Marc Rechté wrote:
> Eric,
> 
> How would you know (debug) that size+time compare fails in a rsync 
> session ?
> 
> Thanks Marc
> 
> Le 12/06/2012 15:39, ericbambach1 at discover.com a écrit :
>> Alan,
>> 
>> What is the rsync command used? If it hits a large group of 
>> files with no differences (easy to believe across 12TB) but has
>> to compare the checksums anyways (forced by you or failing the
>> size+time compare) you'll be I/O bound with almost no
>> corresponding network traffic as it just has to send the
>> checksums.
>> 
>> 
>> Eric Bambach | Discover Senior Assoc. Programmer, Warehouse
>> Infrastructure and Tools 2500 Lake Cook Road, Riverwoods IL
>> 60015 P: 224.405.2896 ericbambach1 at discover.com
>> 
>> 
>> 
>> 
>> From:   Alan McKay<alan.mckay+rsync at gmail.com> 
>> To:<rsync at lists.samba.org> Date:   06/12/2012 08:30 AM Subject:
>> rsync takes long pauses in xfer ? Sent
>> by:<rsync-bounces at lists.samba.org>
>> 
>> 
>> 
>> Hey folks,
>> 
>> I did some googling on this but did not come up with much.  I'm
>> using rsnapshot which uses rsync, and I notice some pretty long
>> pauses in the xfers as you can see on this graph from "munin".
>> THe machine in question right at the moment is doing nothing but
>> rsyncing ( rsnapshoting ) some 12T of NAS storage to local disk,
>> so there is nothing else going on at all.
>> 
>> https://plus.google.com/u/0/photos/113518077816006248932/albums/5732421463318682369/5753139625064539250
>>
>>
>>
>>
>> 
You can see a couple of spots in the graph where it just drops to
>> nothing ( checking more closely you do see a very small bit of 
>> activity )
>> 
>> Here is another graph from MRTG which records the traffic from
>> the switch port side.  You can see around 2am it drops off pretty
>> low, then from about 4am til about 7am it drops even lower.
>> 
>> https://plus.google.com/u/0/photos/113518077816006248932/albums/5732421463318682369/5753140504922328322
>>
>>
>>
>>
>> 
Is that normal?  Or is this something I should ask on the rsnapshot
>> list (if there is one)?
>> 
>> I did find something in google about depending on the types of
>> files it can change xfer rate but not much detail.
>> 
>> thanks, -Alan
> 

- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
	Kevin Korb			Phone:    (407) 252-6853
	Systems Administrator		Internet:
	FutureQuest, Inc.		Kevin at FutureQuest.net  (work)
	Orlando, Florida		kmk at sanitarium.net (personal)
	Web page:			http://www.sanitarium.net/
	PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk/XTaoACgkQVKC1jlbQAQdZmQCg1WfB4HHJ0frAv5/yI0Q+vp7J
y9QAoMe+HNg14Lsb/m9/3b0RTz9BLzji
=8SVj
-----END PGP SIGNATURE-----