sync 54 million files, tuning rsync?
Frank Hamersley
terabite at bigpond.com
Wed Feb 15 01:12:14 GMT 2006
> -----Original Message-----
> From: rsync-bounces+terabite=bigpond.com at lists.samba.org
> Behalf Of Dirk Schenkewitz
> Sent: Tuesday, 14 February 2006 10:32 PM
> To: rsync at lists.samba.org
> Subject: Re: sync 54 million files, tuning rsync? (offlist)
>
> Hi Jerry,
>
> I reply offlist because I'm everything but an expert, so
> you might get a better answer from someone else.
> Anyway, perhaps it would be good if you post to the list
> what you're already doing.
>
> On Tuesday, 14. February 2006 03:31, Jerry wrote:
> > I'm trying to sync up 54 million files. I can break
> > it down into different applications, but I still have
> > to accomplish 17 million files in one "chunk" if
> > possible.
>
[snip]
Jerry,
<OutsideTheSquare>
Given you have 54 million entries have you ever considered using a genuine DBMS (with replication) rather than pounding the filesystem to death?
</OutsideTheSquare>
Cheers, Frank.
More information about the rsync
mailing list