deep vs. shallow directory structure

Shai Ayal shaiay at users.sourceforge.net
Mon Jul 5 05:50:25 MDT 2010


On Mon, Jul 5, 2010 at 1:45 PM, Paul Slootman <paul+rsync at wurtel.net> wrote:
> On Sat 03 Jul 2010, Shai Ayal wrote:
>
>> My question (finally): how to optimize rsync's speed? - how deep should the
>> directory structure be? What would be faster to rsync - 1 directory with 2M
>> files, or 16 directories with 125K files each, or 256 directories with 8K
>> files each, ....
>
> Smaller directories will enable rsync's incremental transfer mode to
> work more efficiently. I'd go for 256 directories in this scenario.
> Rsync can then scan de next directory while transferring the current
> one.
> More directories probably won't help much.

Thanks. Will more directories make the performance worse?

Shai


More information about the rsync mailing list