keep rsync from removing unfinished source files?
matt at mattmccutchen.net
Sun Sep 7 20:42:24 GMT 2008
Aaron, please CC rsync at lists.samba.org so that others can help you and
your message is archived for others' future benefit.
On Sun, 2008-09-07 at 16:16 -0400, Aaron Swartz wrote:
> > IMO, a proper solution is to have the crawler indicate somehow which
> > files are unfinished so rsync can avoid copying those. E.g., the
> > crawler could name unfinished files according to a special pattern so
> > that you could exclude them with --exclude, or it could keep them in a
> > temporary directory that rsync doesn't visit.
> I agree, but this is not how most crawlers are written. (Imagine, e.g. wget.)
Then I would modify the crawler.
More information about the rsync