keep rsync from removing unfinished source files?

[Matt McCutchen]

Aaron, please CC rsync at lists.samba.org so that others can help you and
your message is archived for others' future benefit.

On Sun, 2008-09-07 at 16:16 -0400, Aaron Swartz wrote:
> > IMO, a proper solution is to have the crawler indicate somehow which
> > files are unfinished so rsync can avoid copying those.  E.g., the
> > crawler could name unfinished files according to a special pattern so
> > that you could exclude them with --exclude, or it could keep them in a
> > temporary directory that rsync doesn't visit.
> 
> I agree, but this is not how most crawlers are written. (Imagine, e.g. wget.)

Then I would modify the crawler.

Matt