proposal to speed rsync with lots of files

[lewis butler]

On 5-Mar-2009, at 16:27, Peter Salameh wrote:
> One of the speed-limiting issues with rsync is having to send huge  
> file lists when mirroring large file systems, even for incremental  
> updates where only a small part of the file system might have  
> changed.  My proposal is to first send a checksum of the file list  
> for each directory.  If is found to be identical to the same  
> checksum on the remote side then the list need not be sent for that  
> directory!  That would reduce the size of the file list greatly when  
> there are directories containing many files which do not change from  
> on rsync to the next.

How long does it take to calculate the checksum on the remote  
directory?  Longer than sending the file list?  or are you suggesting  
the checksums be stored on the source and target somehow?


-- 
Bishops move diagonally. That's why they often turn up where the
	kings don't expect them to be.