huge number of files

Matt McCutchen hashproduct+rsync at gmail.com
Fri Jun 22 21:04:11 GMT 2007


On 6/22/07, Ming Zhang <blackmagic02881 at gmail.com> wrote:
> I wonder if rsync can have an option that when it scan the file system
> tree and accumulate to N number of files, it process these files before
> scanning further.

The current CVS rsync works this way ("incremental recursion") by
default.  It will be released as rsync 3.0.0 at some point.

> This might break the operation on files with multiple hard links or
> detecting rename. But we are ok on this.

Right; if you ask for any of those things, the CVS rsync doesn't use
incremental recursion mode.

Matt


More information about the rsync mailing list