many small files

Matt McCutchen hashproduct+rsync at gmail.com
Mon Aug 6 21:23:25 GMT 2007


On 8/4/07, Vitaliy Okulov <vitaliy.okulov at gmail.com> wrote:
> Hi all. I want to syncronize about 20-30 Gb of small files, about 4-10
> k each. How i can speed up process of synchronization?

Try the current development version of rsync 3.0.0 from CVS (see
bottom of http://rsync.samba.org/download.html ).  It has an
incremental recursion mode that dramatically improves performance for
very large numbers of files.  The CVS rsync is not entirely stable
(one crash is currently being investigated), so you might run into
trouble; if so, please report it.

Matt


More information about the rsync mailing list