many small files

Matt McCutchen hashproduct+rsync at
Mon Aug 6 21:23:25 GMT 2007

On 8/4/07, Vitaliy Okulov <vitaliy.okulov at> wrote:
> Hi all. I want to syncronize about 20-30 Gb of small files, about 4-10
> k each. How i can speed up process of synchronization?

Try the current development version of rsync 3.0.0 from CVS (see
bottom of ).  It has an
incremental recursion mode that dramatically improves performance for
very large numbers of files.  The CVS rsync is not entirely stable
(one crash is currently being investigated), so you might run into
trouble; if so, please report it.


More information about the rsync mailing list