Memory consumption for rsync -axv --delete

[Kevin Korb]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

You will have an old backup dir and a new backup dir.  The new one
will contain all the current stuff.  The old one will contain what was
current the last time you ran rsync.  Just rm -rf the old one.  Or
keep a few.  Or a few dozen.

On 03/27/2016 02:54 AM, John Long wrote:
> Thanks I'll look this up. There is still the issue of how to get
> the target box cleaned up since I can no longer run --delete.
> 
> /jl
> 
> On Sun, Mar 27, 2016 at 02:49:02AM -0400, Kevin Korb wrote: You
> miss-understand the purpose of --link-dest.  Yes, it gives you 
> multiple complete backups, but each only consumes the disk space 
> needed to store files that are unique to that backup.  Files that
> are the same in 2 backup runs are actually the same file in
> multiple directories requiring only 1 to actually be stored.
> 
> On 03/27/2016 02:39 AM, John Long wrote:
>>>> Hi,
>>>> 
>>>> On Fri, Mar 25, 2016 at 11:16:47AM -0400, Kevin Korb wrote:
>>>> 
>>>>> If you were using --link-dest to make multiple backups you 
>>>>> wouldn't need --delete because the target is always a new
>>>>> empty directory (with - --link-dest pointing to the
>>>>> previous backup run).
>>>> 
>>>> The source is around 200G and the target box only has 500G
>>>> total and some of it is used for other data. What I want to
>>>> do is mirror the source on the target and be able to prune
>>>> the files that get deleted from the source from the target
>>>> also. I don't have enough space to back up the whole thing
>>>> and that is very time consuming anyway over 100M/b link which
>>>> is why I was using --delete. For a long time it was ok, but
>>>> now I don't have enough RAM.
>>>> 
>>>> There is one giant directory that is probably problematic
>>>> because it has a huge number of files. I suspect this is the
>>>> one that's causing me problems but it is relatively static. I
>>>> suppose it could be backed up and cleaned up separately.
>>>> 
>>>> Is there any way to reduce RAM consumption on the target box
>>>> while still getting the benefit of the --delete function? I
>>>> am thinking of trying to back up everything but the gigantic
>>>> directory with a large number of files, and then backing up
>>>> only that directory. Is this a reasonable strategy? I just
>>>> couldn't understand if --delete with --exclude would delete
>>>> files from the target outside the --exclude path. I guess the
>>>> answer is no but it would be a very time consuming mistake.
>>>> I'm trying to make sure before I try it.
>>>> 
>>>> Thanks for your help and I'm sorry for my poorly worded
>>>> post(s).
>>>> 
>>>> /jl
>>>> 
> 
>> 
>> -- Please use reply-all for most replies to avoid omitting the
>> mailing list. To unsubscribe or change options:
>> https://lists.samba.org/mailman/listinfo/rsync Before posting,
>> read: http://www.catb.org/~esr/faqs/smart-questions.html
> 

- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
	Kevin Korb			Phone:    (407) 252-6853
	Systems Administrator		Internet:
	FutureQuest, Inc.		Kevin at FutureQuest.net  (work)
	Orlando, Florida		kmk at sanitarium.net (personal)
	Web page:			http://www.sanitarium.net/
	PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iEYEARECAAYFAlb3hKgACgkQVKC1jlbQAQdqCgCdGPKy5BJGKP5oqwHFIt+I6zvw
dgcAoJGkHyaai+LWPIWXiCDwTxz8V21+
=Gpd0
-----END PGP SIGNATURE-----