rsync out of memory problem

[jw schultz]

On Fri, Jun 13, 2003 at 12:39:06PM -0400, Steve Thompson wrote:
> Using an rsync (V2.5.6, Tru64 Unix 5.1A) command of the form:
> 
> 	rsync -avz --delete /some/dir remhost:/some/other/dir
> 
> where /some/dir has about 460,000 files in it, I get:
> 
> building file list ... done
> ERROR: out of memory in make_file
> rsync error: error allocating core memory buffers (code 22) at /usr/common/src/rsync-2.5.6/util.c(115)
> rsync: connection unexpectedly closed (8 bytes read so far)
> rsync error: error in rsync protocol data stream (code 12) at /usr/common/src/rsync-2.5.6/io.c(165)
> 
> However, rsync has only increased in resident size to about 72 MB at this
> point, while I have limits of:
> 
> 	cputime         unlimited
> 	filesize        unlimited
> 	datasize        8192MB
> 	stacksize       1024MB
> 	coredumpsize    unlimited
> 	resident        16033MB
> 	descriptors     4096
> 	addressspace    8192MB
> 
> Any comments? I have not seen anything in the archives that addresses
> this. Thanks,

Malloc failed.  Rsync did what it was supposed to do when
malloc fails.  The processes RSS is less important than
size.  Either your system ran out of available memory+swap
or hit a bug in malloc or some issue with sbrk or mmap.
In any case the worst claim you could make against rsync is
that it exposed an underlying problem.

I am curious what the point of limiting RSS to 16GB when the
addressspace is 8BG.

-- 
________________________________________________________________
	J.W. Schultz            Pegasystems Technologies
	email address:		jw at pegasys.ws

		Remember Cernan and Schmitt