deep vs. shallow directory structure
shaiay at users.sourceforge.net
Mon Jul 5 05:50:25 MDT 2010
On Mon, Jul 5, 2010 at 1:45 PM, Paul Slootman <paul+rsync at wurtel.net> wrote:
> On Sat 03 Jul 2010, Shai Ayal wrote:
>> My question (finally): how to optimize rsync's speed? - how deep should the
>> directory structure be? What would be faster to rsync - 1 directory with 2M
>> files, or 16 directories with 125K files each, or 256 directories with 8K
>> files each, ....
> Smaller directories will enable rsync's incremental transfer mode to
> work more efficiently. I'd go for 256 directories in this scenario.
> Rsync can then scan de next directory while transferring the current
> More directories probably won't help much.
Thanks. Will more directories make the performance worse?
More information about the rsync