Dump Analysis -- when NCR server frozen by rsync

[Dave Dykstra]

You're saying the whole system froze?  I don't see how that can be caused
by an application process.  It sounds like from the report of the NCR
engineer that a lot of applications were waiting on a lock to be released
by rsync, but why would they be?  If you had killed the rsync process,
would it have allowed the system to free up?

- Dave Dykstra

On Mon, Feb 18, 2002 at 03:22:41PM -0500, Mike.Li at schenker.ca wrote:
> Hi,
> rsync was running against filesystems /disk5 and /disk7 to back them onto 
> remote server (172.16.101.4) using the following script:
> if [ `ps -ef | grep -v grep | grep ::d5 | /usr/bin/wc -l` -eq 0 ]
> then
> rm -f /etc/rsync5.log
> echo " --- Disk5 --- starts `date`" > /etc/rsync5.log
> /usr/local/bin/rsync -a --recursive --compress /disk5/ 172.16.101.4::d5 >> 
> /etc/rsync.log
> echo "`cat /etc/rsync5.log` --- Disk5 --- Finishes `date`" >> 
> /etc/rsync.log
> else
> echo "-- Disk5 rsync running `date`" >> /etc/rsync.log
> fi
> 
> Here is the analysis of the freezing from the NCR engineer:
> Pls advise if any other's experienced this problem before. Thanks.
> 
> SCL3550:/usr/local/bin>rsync --version
> rsync  version 2.5.1  protocol version 25
> Copyright (C) 1996-2001 by Andrew Tridgell and others
> <http://rsync.samba.org/>
> Capabilities: 32-bit files, socketpairs, hard links, symlinks, batchfiles, 
> no I6
> 
> WARNING: no 64-bit integers on this platform!
> 
> ---
> My dump analysis shows that the reason for the system hang is the  227
> processes sleeping on locked ( vxfs ) inodes ( priority 94 ).  Of these, 
> 179
> were sleeping on the vxfs inode c3fb4ac0, 37 on vxfs inode c43ba400,  3 on
> the vxfs inode c379eb81, 1 on the vxfs inode c368e280 , 3 on the vxfs 
> inode
> c50add80, and 1 on the vxfs inode c3c06570.  If we examine the vxfs inode
> c3bf4ac0, we note that the rowner is rsync.  When we examine the stack, I
> noted that we are in DAP code.  I suggest that we engage the third party
> vendor for rsync support.  If you have any questions or concerns, please
> contact me.
> Best regards,
> Bea
> Beatrice Lyons-Daniels
> Solution Engineer
> 3325 Platt Springs Road
> West Columbia,  SC  29170
> > *(803)-939-7845  V+ 633-7845   FAX: (803)-939-7707
> > * beatrice.lyons-daniels at ncr.com
> >