[Bug 13082] New: [REQ] Hardware / SSE based MD5 operations

samba-bugs at samba.org samba-bugs at samba.org
Thu Oct 12 11:31:40 UTC 2017


            Bug ID: 13082
           Summary: [REQ] Hardware / SSE based MD5 operations
           Product: rsync
           Version: 3.1.3
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: P5
         Component: core
          Assignee: wayned at samba.org
          Reporter: ben.rubson at gmail.com
        QA Contact: rsync-qa at samba.org


I made some performance tests and ses that rsync can be a bottleneck while it
is calculating hashes of basis files (not a surprise).

For example, while I can read a big test file directly from the storage at 300
MB/s, rsync checksums it at about 200 MB/s.

Thus impact of calculating hashes for big files can be quite important (some
minutes for files of several hundreds of GB).

Then, what about MD5 implementation based on SSE ?
Do you think we would have a performance improvement ?

Thank you !


You are receiving this mail because:
You are the QA Contact for the bug.

More information about the rsync mailing list