Problem with large number of files and --delete
jw schultz
jw at pegasys.ws
Thu Jul 3 08:45:17 EST 2003
On Wed, Jul 02, 2003 at 05:29:04PM -0500, Tom Walsh wrote:
> I have encountered an interesting problem when trying to move over a mail
> store last night...
>
> I tried to rsync our mail store from our old mail server to the new mail
> store... minimal changes to the data since I had rsynced it not 3 hours
> before... The mailstore in total is 14GB total.
>
> Here is what I am using:
>
> /usr/local/bin/rsync --verbose --progress --stats --compress --rsh=/usr/bin/
> "slogin -l root -o
> Compression=yes" --recursive --times --links --perms --owner --group --delet
> e 204.251.239.243:/usr/home/vpopmail/domains/ala.net/
> /nfsmount/maildir/ala.net/
>
> And after it counts the files... I get the following:
>
> receiving file list ...
> 2022175 files to consider
> ERROR: out of memory in make_file
> rsync error: error allocating core memory buffers (code 22) at util.c(115)
>
> The client (204.251.239.243) is running rsync 2.5.6 under Freebsd 4.2.
> The server (the nfsstore) is running rsync 2.5.6 under Freebsd 4.8.
>
> This only occurs when I add the --delete to the above line... if I omit
> the --delete, it runs fine.
>
> Is this possibly a ulimit problem?
Yes. The error just means that malloc failed. Malloc
can fail if you hit ulimit but it is more likely that you
ran out of memory.
--
________________________________________________________________
J.W. Schultz Pegasystems Technologies
email address: jw at pegasys.ws
Remember Cernan and Schmitt
More information about the rsync
mailing list