Multi-Threading?

[CACook at quantum-sci.com]

Thanks, but the whole function of my backup server pivots on rsync features.

Need something rsync-like, but multi-threaded, or with a whole lot less overhead.


On Tuesday 17 May, 2011 09:18:01 Chris Hawkins wrote:
> I have no idea about potential rsync modifications, but you might try FDT to solve this problem:
> 
> http://monalisa.cern.ch/FDT/
> 
> I have found it easy to use and it absolutely maxes all available bandwidth for the fastest possible data transfer. It doesn't have rsync goodies like update and only changed data, but it's multithreaded, multi-stream, and all around a really fast data mover.
> 
> Chris 
> 
> ----- Original Message -----
> > I have a backup server now restoring 6TB of data to a client machine.
> > This has been going on for four days now, and no sign of getting close
> > to completion.
> > 
> > The connexion is Gb enet end-to-end, and is running at only 40Mb/s. It
> > has far more capacity than that. The only limiting factor I can see is
> > on the backup server one core of the CPU is running 100% rsync.
> > Clearly rsync is not multi-threaded.
> > 
> > In researching this I find that a change to multi-threaded goodness
> > would require a massive rewrite, and would only be considered for an
> > rsync replacement.
> > 
> > Is there such a replacement in the offing? Is there any sort of
> > workaround for the time being? ATM the large amount of data is the
> > /home directory on the client machine.
> > 
> > --
> > Please use reply-all for most replies to avoid omitting the mailing
> > list.
> > To unsubscribe or change options:
> > https://lists.samba.org/mailman/listinfo/rsync
> > Before posting, read:
> > http://www.catb.org/~esr/faqs/smart-questions.html
>