Memory consumption for rsync -axv --delete

[drsalists]

You could probably use CIFS, NFS or sshfs.  It wouldn't be as fast, but the memory requirements should be less.


Sent from my T-Mobile 4G LTE Device

<div>-------- Original message --------</div><div>From: John Long <codeblue at inbox.lv> </div><div>Date:2016/03/25  04:10  (GMT-08:00) </div><div>To: rsync at lists.samba.org </div><div>Cc:  </div><div>Subject: Re: Memory consumption for rsync -axv --delete </div><div>
</div>On Fri, Mar 25, 2016 at 09:54:14AM +0000, John Long wrote:
> Hi,
> 
> I have been using rsync for many years and never had any kind of problem.
> Lately I am running out of RAM trying to do an incremental backup to a box
> that only has 2G of RAM. The entire directory structure I'm mirroring is
> about 200G of files. A minority of subdirectories have many files.
> 
> Is there a way to do an incremental backup with --delete option that does
> not use as much memory? Is there a way to tell rsync to use a tempfile
> instead of RAM for keeping tracking of whatever it does?
> 
> And would it be useful to add ignores for the subdirectories I know have
> many files and back them up separately? Is --delete safe to use in this
> case, as in does --delete with --ignore somedir/ not delete files in other
> target dirs that are not in the ignore path?

I didn't phrase this part very well. Is --delete safe to use with --ignore,
meaning will rsync avoid deleting files in the ignore path on the target
side? I think the answer is probably yes but since I'm crashing the target
box with --delete I don't want to have to try this too many times.

Really I'm looking for a workaround to the high memory consumption so I can
sync up the file trees without exceeding the small RAM capacity of the
target box. Any suggestions appreciated.

Thanks,

/jl

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/rsync/attachments/20160327/605b695c/attachment.html>