rsync is slowing down
Tim Conway
conway at us.ibm.com
Fri Apr 9 04:22:39 GMT 2004
I wrote a tool to get around a similar problem. In my case, I had to bail
on rsync altogether... the hardware was just too unreliable and limited in
resources.
I've BCCd the current custodian of that tool, who was at least at one time
a member of this list. If my old company has no objection to the sharing
if my IP and he gets a moment to come up for air amid his drowning in both
his and my work, maybe he can post it. If you're going to drive rsync
with it, you'll need some mods, as currently, it uses packetized tar....
heck, you'll need mods anyway, as it's got a lot of bug workarounds to get
along with the incompetent Maxtor NAS devices, and the code is so ugly,
you may have to rewrite it anyway just to avoid hurting your eyes.
Tim Conway
Unix System Administration
Contractor - IBM Global Services
desk:3032734776
conway at us.ibm.com
Phil Howard <phil-rsync-2 at ipal.net>
Sent by: rsync-bounces+conway=us.ibm.com at lists.samba.org
04/07/2004 05:44 PM
To
rsync at lists.samba.org
cc
Subject
Re: rsync is slowing down
On Sat, Apr 03, 2004 at 12:23:59PM -0800, Wayne Davison wrote:
| You can implement such optimizations on top of rsync using either
| excludes or the --files-from option. For instance, if the sending
| side maintained an exclude file of old directories that didn't need
| to be transferred, you could write a script that would look for
| updated items and remove the appropriate exclusion. An exclude list
| would have to be grabbed first from the remote side before it could
| be used, though.
How would the sending side know what directories are "old" for a
given receiver? One receiving side may run their update today for
an old directory that had one file changed. But another receiving
side may not run its update for a few more days or even weeks.
This sounds like the sending side needs to keep track of what each
different receiver has or doesn't have. That's what I used to do
before rsync.
--
-----------------------------------------------------------------------------
| Phil Howard KA9WGN | http://linuxhomepage.com/
http://ham.org/ |
| (first name) at ipal.net | http://phil.ipal.org/
http://ka9wgn.ham.org/ |
-----------------------------------------------------------------------------
--
To unsubscribe or change options:
http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
More information about the rsync
mailing list