performance with >50GB files

[Wayne Davison]

On Tue, Jan 10, 2006 at 07:46:19PM +0100, Ren? Rebe wrote:
> of course the dual cpu ppc64 receiver is idling waiting for any data
> to arrive.

There is a known problem with really large numbers of blocks: the hash
search algorithm gets too many collisions, and the search routine bogs
down.  This sounds like what is happening to you.  Unfortunately, I can
offer no suggestions for relief other than breaking up the file(s) into
smaller parts.

..wayne..