sync 54 million files, tuning rsync?

Frank Hamersley terabite at bigpond.com
Wed Feb 15 01:12:14 GMT 2006


> -----Original Message-----
> From: rsync-bounces+terabite=bigpond.com at lists.samba.org
> Behalf Of Dirk Schenkewitz
> Sent: Tuesday, 14 February 2006 10:32 PM
> To: rsync at lists.samba.org
> Subject: Re: sync 54 million files, tuning rsync? (offlist)
> 
> Hi Jerry,
> 
> I reply offlist because I'm everything but an expert, so
> you might get a better answer from someone else.
> Anyway, perhaps it would be good if you post to the list 
> what you're already doing.
> 
> On Tuesday, 14. February 2006 03:31, Jerry wrote:
> > I'm trying to sync up 54 million files.  I can break
> > it down into different applications, but I still have
> > to accomplish 17 million files in one "chunk" if
> > possible.
> 
[snip]
Jerry,

<OutsideTheSquare>
Given you have 54 million entries have you ever considered using a genuine DBMS (with replication) rather than pounding the filesystem to death?
</OutsideTheSquare>

Cheers, Frank.



More information about the rsync mailing list