Memory consumption for rsync -axv --delete
kmk at sanitarium.net
Sun Mar 27 06:58:49 UTC 2016
-----BEGIN PGP SIGNED MESSAGE-----
You will have an old backup dir and a new backup dir. The new one
will contain all the current stuff. The old one will contain what was
current the last time you ran rsync. Just rm -rf the old one. Or
keep a few. Or a few dozen.
On 03/27/2016 02:54 AM, John Long wrote:
> Thanks I'll look this up. There is still the issue of how to get
> the target box cleaned up since I can no longer run --delete.
> On Sun, Mar 27, 2016 at 02:49:02AM -0400, Kevin Korb wrote: You
> miss-understand the purpose of --link-dest. Yes, it gives you
> multiple complete backups, but each only consumes the disk space
> needed to store files that are unique to that backup. Files that
> are the same in 2 backup runs are actually the same file in
> multiple directories requiring only 1 to actually be stored.
> On 03/27/2016 02:39 AM, John Long wrote:
>>>> On Fri, Mar 25, 2016 at 11:16:47AM -0400, Kevin Korb wrote:
>>>>> If you were using --link-dest to make multiple backups you
>>>>> wouldn't need --delete because the target is always a new
>>>>> empty directory (with - --link-dest pointing to the
>>>>> previous backup run).
>>>> The source is around 200G and the target box only has 500G
>>>> total and some of it is used for other data. What I want to
>>>> do is mirror the source on the target and be able to prune
>>>> the files that get deleted from the source from the target
>>>> also. I don't have enough space to back up the whole thing
>>>> and that is very time consuming anyway over 100M/b link which
>>>> is why I was using --delete. For a long time it was ok, but
>>>> now I don't have enough RAM.
>>>> There is one giant directory that is probably problematic
>>>> because it has a huge number of files. I suspect this is the
>>>> one that's causing me problems but it is relatively static. I
>>>> suppose it could be backed up and cleaned up separately.
>>>> Is there any way to reduce RAM consumption on the target box
>>>> while still getting the benefit of the --delete function? I
>>>> am thinking of trying to back up everything but the gigantic
>>>> directory with a large number of files, and then backing up
>>>> only that directory. Is this a reasonable strategy? I just
>>>> couldn't understand if --delete with --exclude would delete
>>>> files from the target outside the --exclude path. I guess the
>>>> answer is no but it would be a very time consuming mistake.
>>>> I'm trying to make sure before I try it.
>>>> Thanks for your help and I'm sorry for my poorly worded
>> -- Please use reply-all for most replies to avoid omitting the
>> mailing list. To unsubscribe or change options:
>> https://lists.samba.org/mailman/listinfo/rsync Before posting,
>> read: http://www.catb.org/~esr/faqs/smart-questions.html
Kevin Korb Phone: (407) 252-6853
Systems Administrator Internet:
FutureQuest, Inc. Kevin at FutureQuest.net (work)
Orlando, Florida kmk at sanitarium.net (personal)
Web page: http://www.sanitarium.net/
PGP public key available on web site.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2
-----END PGP SIGNATURE-----
More information about the rsync