Problem with large number of files and --delete

jw schultz jw at pegasys.ws
Thu Jul 3 08:45:17 EST 2003


On Wed, Jul 02, 2003 at 05:29:04PM -0500, Tom Walsh wrote:
> I have encountered an interesting problem when trying to move over a mail
> store last night...
> 
> I tried to rsync our mail store from our old mail server to the new mail
> store... minimal changes to the data since I had rsynced it not 3 hours
> before... The mailstore in total is 14GB total.
> 
> Here is what I am using:
> 
> /usr/local/bin/rsync --verbose --progress --stats --compress --rsh=/usr/bin/
> "slogin -l root -o
> Compression=yes" --recursive --times --links --perms --owner --group --delet
> e 204.251.239.243:/usr/home/vpopmail/domains/ala.net/
> /nfsmount/maildir/ala.net/
> 
> And after it counts the files... I get the following:
> 
> receiving file list ...
> 2022175 files to consider
> ERROR: out of memory in make_file
> rsync error: error allocating core memory buffers (code 22) at util.c(115)
> 
> The client (204.251.239.243) is running rsync 2.5.6 under Freebsd 4.2.
> The server (the nfsstore) is running rsync 2.5.6 under Freebsd 4.8.
> 
> This only occurs when I add the --delete to the above line... if I omit
> the --delete, it runs fine.
> 
> Is this possibly a ulimit problem?

Yes.  The error just means that malloc failed.  Malloc
can fail if you hit ulimit but it is more likely that you
ran out of memory.



-- 
________________________________________________________________
	J.W. Schultz            Pegasystems Technologies
	email address:		jw at pegasys.ws

		Remember Cernan and Schmitt



More information about the rsync mailing list