Dynamic hash table size (with static has load)

Shachar Shemesh rsync at shemesh.biz
Sat Feb 25 11:25:52 GMT 2006


Hi list, and Wayne in particular,


It was almost a year since we had the discussion (with
http://lists.samba.org/archive/rsync/2005-March/011875.html as it's
conclusion) regarding chances for hash collisions and large files. As
now we have someone asking about synching 5TB files, I decided to
actually submit a patch.


Attached is a patch that uses a non-predetermined hash table size, so
that the hash cell load (alpha) is never more than 80%. As far as my
understanding of rsync goes, this requires no change in the rsync protocol.


Comments welcome,


Shachar

-------------- next part --------------
A non-text attachment was scrubbed...
Name: dynamic_hash.patch
Type: text/x-patch
Size: 1454 bytes
Desc: not available
Url : http://lists.samba.org/archive/rsync/attachments/20060225/62f748cc/dynamic_hash.bin


More information about the rsync mailing list