Rsync and RAID storage specifications
Kevin Korb
kmk at sanitarium.net
Sat Aug 3 15:23:36 MDT 2013
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
It probably isn't going to make much of a difference. The bottleneck
will be in the networking.
On 08/03/13 15:46, AZ 9901 wrote:
> Let's say that I would like to try using --link-dest :-)
>
> What about RAID specifications (type, number of disks, chunk
> size...) on receiver side ?
>
> For example, should I use 256K chunks, same size as the IOs made by
> the Rsync daemon / receiver ?
>
> Thank you very much !
>
> Ben
>
> Le 12 juil. 2013 à 19:29, Kevin Korb a écrit :
>> With millions of files I suggest ditching --link-dest and using
>> ZFS with subvolume snapshots. You will have nothing but pain
>> trying to deal with many millions of links.
>>
>> On 07/12/13 12:48, AZ 9901 wrote:
>>> Hello,
>>>
>>> I am going to use Rsync over millions of files, with
>>> --link-dest option. So huge read activity at the beginning of
>>> each backup, and huge hard links creation activity.
>>>
>>> Of course I will use a RAID array on receiver side, dedicated
>>> to Rsync.
>>>
>>> Do you have any recommandation over RAID type, number of disks
>>> and chunk size to use ?
- --
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
Kevin Korb Phone: (407) 252-6853
Systems Administrator Internet:
FutureQuest, Inc. Kevin at FutureQuest.net (work)
Orlando, Florida kmk at sanitarium.net (personal)
Web page: http://www.sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.20 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iEYEARECAAYFAlH9dNcACgkQVKC1jlbQAQdhgQCg5LUug5By2WaqYccKnSEgync4
8RMAoI/gPM0N7Ch8zE73VmymZR41biT+
=lWq8
-----END PGP SIGNATURE-----
More information about the rsync
mailing list