rsync compares all files again and again
kmk at sanitarium.net
Tue Oct 18 12:16:42 MDT 2011
-----BEGIN PGP SIGNED MESSAGE-----
Ext's dirindex feature does help but only in that it allows rsync
and any other program to read a large directory faster.
On 10/18/11 13:41, Eric Shubert wrote:
> On 10/14/2011 02:13 AM, Frank Steiner wrote:
>> we do a 1:1 backup from our main raid to a backup raid every night with
>> rsync -a --delete /mnt/raid1/ /mnt/raid2
>> rsync is 3.09, filesystems are ext3, OS is SLES 11 SP1.
>> The rsync process takes several hours, even if no file has changed at
>> Using -vv I see that rsync compares all files every time and that takes
>> long for some hundreds of millions of small files.
>> Can I tell rsync it should not compare files in a directory if the
>> directory has not changed, i.e., ctime is the same in source and target?
>> I.e., when I have a dir x with a subdir y and a file y1 in it, I see:
>> rsync -avv x z
>> created directory z
>> delta-transmission disabled for local transfer or --whole-file
>> on the first run and
>> rsync -avv x z
>> x/y/y1 is uptodate
>> on every following run. Why does rsync compare y1 again?
>> I couldn't find a solution in the mailing list or FAQ and when googling.
>> I found a mail in this list telling that -a was the culprit and one
>> should add -O to fix it, but it doesn't make any difference.
> Perhaps using the ext3 dirindex option would help?
Kevin Korb Phone: (407) 252-6853
Systems Administrator Internet:
FutureQuest, Inc. Kevin at FutureQuest.net (work)
Orlando, Florida kmk at sanitarium.net (personal)
Web page: http://www.sanitarium.net/
PGP public key available on web site.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
-----END PGP SIGNATURE-----
More information about the rsync