Rsync and RAID storage specifications

Kevin Korb kmk at sanitarium.net
Fri Jul 12 11:29:50 MDT 2013


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

With millions of files I suggest ditching --link-dest and using ZFS
with subvolume snapshots.  You will have nothing but pain trying to
deal with many millions of links.

On 07/12/13 12:48, AZ 9901 wrote:
> Hello,
> 
> I am going to use Rsync over millions of files, with --link-dest
> option. So huge read activity at the beginning of each backup, and
> huge hard links creation activity.
> 
> Of course I will use a RAID array on receiver side, dedicated to
> Rsync.
> 
> Do you have any recommandation over RAID type, number of disks and
> chunk size to use ?
> 
> Thank you very much !
> 
> Ben
> 

- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
	Kevin Korb			Phone:    (407) 252-6853
	Systems Administrator		Internet:
	FutureQuest, Inc.		Kevin at FutureQuest.net  (work)
	Orlando, Florida		kmk at sanitarium.net (personal)
	Web page:			http://www.sanitarium.net/
	PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.20 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlHgPQ4ACgkQVKC1jlbQAQcrhQCfXBThu9qveub+SlVZFfy/WXQQ
9i0AnjA2blfkJe1MgHn/2kwE/ayJfnjO
=wFIA
-----END PGP SIGNATURE-----


More information about the rsync mailing list