Extremely poor rsync performance on very large files (near 100GB and larger)

[Wayne Davison]

On Mon, Jan 08, 2007 at 10:16:01AM -0800, Wayne Davison wrote:
> And one final thought that occurred to me:  it would also be possible
> for the sender to segment a really large file into several chunks,
> handling each one without overlap, all without the generator or the
> receiver knowing that it was happening.

I have a patch that implements this:

http://rsync.samba.org/ftp/unpacked/rsync/patches/segment_large_hash.diff

I'm wondering if anyone has any feedback on such a method being included
in rsync?

..wayne..