Rsync help needed...

[Linus Hicks]

Here's my contribution to information on performance. There are two different 
cases. The first is a 1.6gb file that has a low volume of updates. The second 
case is a 4gb file that has a high volume. All are non-local transfers. I do not 
understand the exceeding long times shown in the last two runs.

=============== Initial copy of a 1.6gb file =================

junk $> timex rsync -ptgo --stats --rsh=/bin/rsh -B 8192 
sun-canada:/c01/oradata/can/system01.dbf /c04/oradata/junk

Number of files: 1
Number of files transferred: 1
Total file size: 1677729792 bytes
Total transferred file size: 1677729792 bytes
Literal data: 1677729792 bytes
Matched data: 0 bytes
File list size: 67
Total bytes sent: 36
Total bytes received: 1677934719

sent 36 bytes  received 1677934719 bytes  12383282.32 bytes/sec
total size is 1677729792  speedup is 1.00

real     2:15.87
user     1:18.00
sys      1:14.39

============ Minor modifications to 1.6gb file no --inplace ============

junk $> timex rsync -ptgo --stats --rsh=/bin/rsh -B 8192 
sun-canada:/c01/oradata/can/system01.dbf /c04/oradata/junk

Number of files: 1
Number of files transferred: 1
Total file size: 1677729792 bytes
Total transferred file size: 1677729792 bytes
Literal data: 1605632 bytes
Matched data: 1676124160 bytes
File list size: 67
Total bytes sent: 1638444
Total bytes received: 2424703

sent 1638444 bytes  received 2424703 bytes  18179.63 bytes/sec
total size is 1677729792  speedup is 412.91

real     3:42.92
user     3:05.73
sys        28.95

=========== Minor modifications to 1.6gb file with --inplace ===========

junk $> timex rsync -ptgo --stats --rsh=/bin/rsh -B 8192 --inplace 
sun-canada:/c01/oradata/can/system01.dbf /c04/oradata/junk/

Number of files: 1
Number of files transferred: 1
Total file size: 1677729792 bytes
Total transferred file size: 1677729792 bytes
Literal data: 163840 bytes
Matched data: 1677565952 bytes
File list size: 67
Total bytes sent: 1638444
Total bytes received: 983127

sent 1638444 bytes  received 983127 bytes  12757.04 bytes/sec
total size is 1677729792  speedup is 639.97

real     3:25.70
user     3:04.26
sys        15.81



============== Initial copy of a 4gb file ===============

oracle> timex rsync -ptgo --stats --rsh=/bin/rsh -B 8192 
sun001:/hs01/oradata/prod1/temp01.dbf /a01/home/oracle/clh/junk/

Number of files: 1
Number of files transferred: 1
Total file size: 4280991744 bytes
Total transferred file size: 4280991744 bytes
Literal data: 4280991744 bytes
Matched data: 0 bytes
File list size: 72
Total bytes sent: 36
Total bytes received: 4281514456

sent 36 bytes  received 4281514456 bytes  9610582.47 bytes/sec
total size is 4280991744  speedup is 1.00

real     7:25.63
user     1:21.58
sys      3:10.29

========== Major modifications, about 75% modified using --inplace =========

oracle> timex rsync -ptgo --stats --rsh=/bin/rsh --inplace -B 8192 
sun001:/hs01/oradata/prod1/temp01.dbf /a01/home/oracle/clh/junk/

Number of files: 1
Number of files transferred: 1
Total file size: 4280991744 bytes
Total transferred file size: 4280991744 bytes
Literal data: 3092414464 bytes
Matched data: 1188577280 bytes
File list size: 72
Total bytes sent: 4180692
Total bytes received: 3093372644

sent 4180692 bytes  received 3093372644 bytes  235081.65 bytes/sec
total size is 4280991744  speedup is 1.38

real  3:39:35.86
user     1:50.09
sys      2:54.95

=========== Major modifications, about 85% modified no --inplace ===========

oracle> timex rsync -ptgo --stats --rsh=/bin/rsh -B 8192 
sun001:/hs01/oradata/prod1/temp01.dbf /a01/home/oracle/clh/junk/

Number of files: 1
Number of files transferred: 1
Total file size: 4280991744 bytes
Total transferred file size: 4280991744 bytes
Literal data: 3677151232 bytes
Matched data: 603840512 bytes
File list size: 72
Total bytes sent: 4180692
Total bytes received: 3677895136

sent 4180692 bytes  received 3677895136 bytes  239960.63 bytes/sec
total size is 4280991744  speedup is 1.16

real  4:15:44.80
user     2:00.30
sys      3:33.63