Extremely slow on certain files
jdrukman at gmail.com
Thu Apr 12 17:35:37 GMT 2007
I'm trying to rsync a large data set (approx 140K files, 4TB) between machines
directly connected on gigabit ethernet.
Normally it runs around 20MB/sec, which is acceptable.
However, it seems like there is one particular file that is giving rsync
heartburn... whenever it encounters this file, the speed drops down to 150KB/sec
speed within a few seconds. I don't know what's so special about this file.
I've tried scp'ing it directly between boxes - 20MB/sec.
I tried rsync in ssh and daemon modes, same deal - 150KB/sec.
rsync 2.6.9 on Redhat EL4 (x86_64).
/opt/bin/rsync -av --progress --port=8738 gsc free c15-gs-deliv1-data1::d4
building file list ...
52478 files to consider
96436224 28% 154.31kB/s 0:25:53
More information about the rsync