huge number of files

Christoph Biedl cbiedl at gmx.de
Fri Jun 22 19:54:42 GMT 2007


Ming Zhang wrote...

> I wonder if rsync can have an option that when it scan the file system
> tree and accumulate to N number of files, it process these files before
> scanning further.

I'd suggest to run rsync in each directory, without the --recursive
option.  But this should happen within rsync else fork and parameter
parsing would take too much ressorces.

> This might break the operation on files with multiple hard links or
> detecting rename. But we are ok on this.

Indeed.  Somehow I get the feeling such a feature is requested at least
once per month.

    Christoph


More information about the rsync mailing list