rsync compares all files again and again

Kevin Korb kmk at
Tue Oct 18 12:16:42 MDT 2011

Hash: SHA1

Ext[34]'s dirindex feature does help but only in that it allows rsync
and any other program to read a large directory faster.

On 10/18/11 13:41, Eric Shubert wrote:
> On 10/14/2011 02:13 AM, Frank Steiner wrote:
>> Hi,
>> we do a 1:1 backup from our main raid to a backup raid every night with
>> rsync -a --delete /mnt/raid1/ /mnt/raid2
>> rsync is 3.09, filesystems are ext3, OS is SLES 11 SP1.
>> The rsync process takes several hours, even if no file has changed at
>> all.
>> Using -vv I see that rsync compares all files every time and that takes
>> long for some hundreds of millions of small files.
>> Can I tell rsync it should not compare files in a directory if the
>> directory has not changed, i.e., ctime is the same in source and target?
>> I.e., when I have a dir x with a subdir y and a file y1 in it, I see:
>> rsync -avv x z
>> created directory z
>> delta-transmission disabled for local transfer or --whole-file
>> x/
>> x/y/
>> x/y/y1
>> on the first run and
>> rsync -avv x z
>> x/y/y1 is uptodate
>> on every following run. Why does rsync compare y1 again?
>> I couldn't find a solution in the mailing list or FAQ and when googling.
>> I found a mail in this list telling that -a was the culprit and one
>> should add -O to fix it, but it doesn't make any difference.
>> cu,
>> Frank
> Perhaps using the ext3 dirindex option would help?

- -- 
	Kevin Korb			Phone:    (407) 252-6853
	Systems Administrator		Internet:
	FutureQuest, Inc.		Kevin at  (work)
	Orlando, Florida		kmk at (personal)
	Web page:
	PGP public key available on web site.
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla -


More information about the rsync mailing list