rsync is slowing down

[Tim Conway]

I wrote a tool to get around a similar problem.  In my case, I had to bail 
on rsync altogether... the hardware was just too unreliable and limited in 
resources.
I've BCCd the current custodian of that tool, who was at least at one time 
a member of this list.  If my old company has no objection to the sharing 
if my IP and he gets a moment to come up for air amid his drowning in both 
his and my work, maybe he can post it.  If you're going to drive rsync 
with it, you'll need some mods, as currently, it uses packetized tar.... 
heck, you'll need mods anyway, as it's got a lot of bug workarounds to get 
along with the incompetent Maxtor NAS devices, and the code is so ugly, 
you may have to rewrite it anyway just to avoid hurting your eyes.

Tim Conway
Unix System Administration
Contractor - IBM Global Services
desk:3032734776
conway at us.ibm.com




Phil Howard <phil-rsync-2 at ipal.net> 
Sent by: rsync-bounces+conway=us.ibm.com at lists.samba.org
04/07/2004 05:44 PM

To
rsync at lists.samba.org
cc

Subject
Re: rsync is slowing down






On Sat, Apr 03, 2004 at 12:23:59PM -0800, Wayne Davison wrote:

| You can implement such optimizations on top of rsync using either
| excludes or the --files-from option.  For instance, if the sending
| side maintained an exclude file of old directories that didn't need
| to be transferred, you could write a script that would look for
| updated items and remove the appropriate exclusion.  An exclude list
| would have to be grabbed first from the remote side before it could
| be used, though.

How would the sending side know what directories are "old" for a
given receiver?  One receiving side may run their update today for
an old directory that had one file changed.  But another receiving
side may not run its update for a few more days or even weeks.

This sounds like the sending side needs to keep track of what each
different receiver has or doesn't have.  That's what I used to do
before rsync.

-- 
-----------------------------------------------------------------------------
| Phil Howard KA9WGN       | http://linuxhomepage.com/      
http://ham.org/ |
| (first name) at ipal.net | http://phil.ipal.org/   
http://ka9wgn.ham.org/ |
-----------------------------------------------------------------------------
-- 
To unsubscribe or change options: 
http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html