retrieve files without local dir compare

[Martin Scharrer]

I agree with the ideas below and like to add the following:

Under Linux/Unix hard links could be used to "copy" the files on the
receiving side. This works around the deleting problem and is way more
efficient to actually copying and deleting the files. I.e.: rsync to folder
'A', then hardlink the folder content recursively to folder 'B' where the
other software is processing and deleting it.

About the other way: --files-from accepts a remote file path if it starts
with ':', see the rsync manual for more details. 

Best,
Martin

 

Fabian Cenedese wrote:
> 
> 
>>We receive meteorological data from a remote server to a local directory
>>(every 5 min).
>>If the data is here, it is imported by a special software, after the
>>import it will be deleted from that directory. The deleting can't be
disabled.
>>Normally I would say, ok download all again, but we get 80GB data per day.
>>
>>If rsync compares the local dir it will download all again, because it's
empty.
>>So rsync has to know what is already downloaded, and only get the new
>>files WITHOUT the dir compare.
>>Does anybody know a way how to realize that?
> 
> One way: keep a local copy which rsync can update. Therefore only the new
> or changed files will get transferred. Then from this (e.g. from the rsync
> output)
> copy the new files into a separate folder where they will be imported from
> (and
> deleted).
> 
> Another way: As Paul mentioned you first need to find out the files to
> copy,
> e.g. have a remote script that gathers all new files into a textfile. Then
> you
> first get this file and then feed it into rsync with --files-from.
> 
> I thought there was a way to tell rsync to only sync files from a specific
> period (as cp can do) but I couldn't find it, maybe not possible.
> 
> bye  Fabi
> 
> -- 
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
> 
> 

-- 
View this message in context: http://www.nabble.com/retrieve-files-without-local-dir-compare-tp25888739p25909069.html
Sent from the Samba - rsync mailing list archive at Nabble.com.