Rsync and RAID storage specifications

Kevin Korb kmk at sanitarium.net
Sat Aug 3 15:23:36 MDT 2013


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

It probably isn't going to make much of a difference.  The bottleneck
will be in the networking.

On 08/03/13 15:46, AZ 9901 wrote:
> Let's say that I would like to try using --link-dest :-)
> 
> What about RAID specifications (type, number of disks, chunk
> size...) on receiver side ?
> 
> For example, should I use 256K chunks, same size as the IOs made by
> the Rsync daemon / receiver ?
> 
> Thank you very much !
> 
> Ben
> 
> Le 12 juil. 2013 à 19:29, Kevin Korb a écrit :
>> With millions of files I suggest ditching --link-dest and using
>> ZFS with subvolume snapshots.  You will have nothing but pain
>> trying to deal with many millions of links.
>> 
>> On 07/12/13 12:48, AZ 9901 wrote:
>>> Hello,
>>> 
>>> I am going to use Rsync over millions of files, with
>>> --link-dest option. So huge read activity at the beginning of
>>> each backup, and huge hard links creation activity.
>>> 
>>> Of course I will use a RAID array on receiver side, dedicated
>>> to Rsync.
>>> 
>>> Do you have any recommandation over RAID type, number of disks
>>> and chunk size to use ?

- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
	Kevin Korb			Phone:    (407) 252-6853
	Systems Administrator		Internet:
	FutureQuest, Inc.		Kevin at FutureQuest.net  (work)
	Orlando, Florida		kmk at sanitarium.net (personal)
	Web page:			http://www.sanitarium.net/
	PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.20 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlH9dNcACgkQVKC1jlbQAQdhgQCg5LUug5By2WaqYccKnSEgync4
8RMAoI/gPM0N7Ch8zE73VmymZR41biT+
=lWq8
-----END PGP SIGNATURE-----


More information about the rsync mailing list