Rsync and RAID storage specifications
az9901 at gmail.com
Sun Aug 4 03:28:20 MDT 2013
Due to --link-dest, I have a huge read activity at the beginning of each backup,
and huge hard links creation activity.
I also plan to have several backups at the same time, coming from dozens of servers.
So I think that I need to pay attention to Rsync daemon storage.
Le 3 août 2013 à 23:23, Kevin Korb a écrit :
> It probably isn't going to make much of a difference. The bottleneck
> will be in the networking.
> On 08/03/13 15:46, AZ 9901 wrote:
>> Let's say that I would like to try using --link-dest :-)
>> What about RAID specifications (type, number of disks, chunk
>> size...) on receiver side ?
>> For example, should I use 256K chunks, same size as the IOs made by
>> the Rsync daemon / receiver ?
>> Le 12 juil. 2013 à 19:29, Kevin Korb a écrit :
>>> With millions of files I suggest ditching --link-dest and using
>>> ZFS with subvolume snapshots. You will have nothing but pain
>>> trying to deal with many millions of links.
>>> On 07/12/13 12:48, AZ 9901 wrote:
>>>> I am going to use Rsync over millions of files, with
>>>> --link-dest option. So huge read activity at the beginning of
>>>> each backup, and huge hard links creation activity.
>>>> Of course I will use a RAID array on receiver side, dedicated
>>>> to Rsync.
>>>> Do you have any recommandation over RAID type, number of disks
>>>> and chunk size to use ?
More information about the rsync