deep vs. shallow directory structure

Paul Slootman paul+rsync at
Mon Jul 5 04:45:59 MDT 2010

On Sat 03 Jul 2010, Shai Ayal wrote:

> My question (finally): how to optimize rsync's speed? - how deep should the
> directory structure be? What would be faster to rsync - 1 directory with 2M
> files, or 16 directories with 125K files each, or 256 directories with 8K
> files each, ....

Smaller directories will enable rsync's incremental transfer mode to
work more efficiently. I'd go for 256 directories in this scenario.
Rsync can then scan de next directory while transferring the current
More directories probably won't help much.


More information about the rsync mailing list