Problem with large number of files and --delete
jw at pegasys.ws
Thu Jul 3 08:45:17 EST 2003
On Wed, Jul 02, 2003 at 05:29:04PM -0500, Tom Walsh wrote:
> I have encountered an interesting problem when trying to move over a mail
> store last night...
> I tried to rsync our mail store from our old mail server to the new mail
> store... minimal changes to the data since I had rsynced it not 3 hours
> before... The mailstore in total is 14GB total.
> Here is what I am using:
> /usr/local/bin/rsync --verbose --progress --stats --compress --rsh=/usr/bin/
> "slogin -l root -o
> Compression=yes" --recursive --times --links --perms --owner --group --delet
> e 22.214.171.124:/usr/home/vpopmail/domains/ala.net/
> And after it counts the files... I get the following:
> receiving file list ...
> 2022175 files to consider
> ERROR: out of memory in make_file
> rsync error: error allocating core memory buffers (code 22) at util.c(115)
> The client (126.96.36.199) is running rsync 2.5.6 under Freebsd 4.2.
> The server (the nfsstore) is running rsync 2.5.6 under Freebsd 4.8.
> This only occurs when I add the --delete to the above line... if I omit
> the --delete, it runs fine.
> Is this possibly a ulimit problem?
Yes. The error just means that malloc failed. Malloc
can fail if you hit ulimit but it is more likely that you
ran out of memory.
J.W. Schultz Pegasystems Technologies
email address: jw at pegasys.ws
Remember Cernan and Schmitt
More information about the rsync