Large file - match process taking days

Rob Bosch robbosch at msn.com
Wed Jul 30 13:41:28 GMT 2008


The files are very similar, a maximum of about 5GB of data differences over
80GB.  The CPU on both sides is low (3-5 percent) and the memory usage is
low (11MB on the client, not sure on the server).

Full rsync options are:

-ruvvvvityz --partial --partial-dir=.rsync-partial --links --ignore-case
--preallocate --ignore-errors --stats --del --block-size=1149728 -I 

I'm using the -I option to force a full sync since date/time changes on
database files is not a reliable measure of changes.

I'll try the block-size at 1638400 although I have not seen a big change in
moving it from about 287000 (default square root) to 1149728.

Rob



More information about the rsync mailing list