deep vs. shallow directory structure

[Paul Slootman]

On Sat 03 Jul 2010, Shai Ayal wrote:

> My question (finally): how to optimize rsync's speed? - how deep should the
> directory structure be? What would be faster to rsync - 1 directory with 2M
> files, or 16 directories with 125K files each, or 256 directories with 8K
> files each, ....

Smaller directories will enable rsync's incremental transfer mode to
work more efficiently. I'd go for 256 directories in this scenario.
Rsync can then scan de next directory while transferring the current
one.
More directories probably won't help much.


Paul