[Bug 2783] New: Random high loads during syncs (server side) / client stream errors

[samba-bugs at samba.org]

https://bugzilla.samba.org/show_bug.cgi?id=2783

           Summary: Random high loads during syncs (server side) / client
                    stream errors
           Product: rsync
           Version: 2.6.4
          Platform: All
               URL: http://bugs.gentoo.org/show_bug.cgi?id=83254
        OS/Version: Linux
            Status: NEW
          Severity: normal
          Priority: P3
         Component: core
        AssignedTo: wayned at samba.org
        ReportedBy: ramereth at gentoo.org
         QAContact: rsync-qa at samba.org


We've recently noticed some issues regarding servers (and clients alike) that
cause either:

A) The server to suddenly have a very high cpu load then diminish
B) Clients having connection errors and not completing a sync.

Here is an example from one of our mirror mailing lists:
www-apache/
www-apps/
www-apps/drupal/files/
www-apps/wordpress/files/
www-client/
www-servers/aolserver/files/
www-servers/jboss/files/
www-servers/resin/files/
www-servers/tomcat/files/
x11-base/
x11-libs/
x11-libs/ecore/files/
x11-libs/gtk+/files/
x11-misc/
x11-plugins/
x11-terms/
x11-themes/
x11-wm/
x11-wm/fluxbox/files/
rsync: connection unexpectedly closed (2761332 bytes received so far)
[generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(365)

>From a server point of view, our loads increase dramatically.
http://dev.gentoo.org/~ramereth/images/raptor-load.png
http://dev.gentoo.org/~ramereth/images/raptor-processes.png

While I know most of the spikes occur at the top of the hour (most likely
cronned syncs from our users), I normally haven't had nagios alerts pop up
warning about loads getting high in the past. I suspect that something is going
on with between the client and server which either creates a timeout and uses a
lot of cpu, or something else is happening.

I should note, that most of our users are probably still using 2.6.0 mainly
because when our users were upgraded to anything higher, we had a lot of errors
while syncing. Perhaps this is a related issue, I'm not sure about that.

There's already a bug open about this in our bugzilla:
https://bugs.gentoo.org/show_bug.cgi?id=83254

I have upgraded one of our rsync servers to 2.6.4 to see if the load issue is
still there. It seems to have reduced it a little, but its still present. This
could be because our users need upgraded as well.

Any ideas or recommendations?

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.