Problem with large number of files and --delete

Tom Walsh slim at ala.net
Thu Jul 3 08:29:04 EST 2003


I have encountered an interesting problem when trying to move over a mail
store last night...

I tried to rsync our mail store from our old mail server to the new mail
store... minimal changes to the data since I had rsynced it not 3 hours
before... The mailstore in total is 14GB total.

Here is what I am using:

/usr/local/bin/rsync --verbose --progress --stats --compress --rsh=/usr/bin/
"slogin -l root -o
Compression=yes" --recursive --times --links --perms --owner --group --delet
e 204.251.239.243:/usr/home/vpopmail/domains/ala.net/
/nfsmount/maildir/ala.net/

And after it counts the files... I get the following:

receiving file list ...
2022175 files to consider
ERROR: out of memory in make_file
rsync error: error allocating core memory buffers (code 22) at util.c(115)

The client (204.251.239.243) is running rsync 2.5.6 under Freebsd 4.2.
The server (the nfsstore) is running rsync 2.5.6 under Freebsd 4.8.

This only occurs when I add the --delete to the above line... if I omit
the --delete, it runs fine.

Is this possibly a ulimit problem?

Tom Walsh






More information about the rsync mailing list