performance problem of using parallel rsync to stage data from 1 source to multiple destination

[Paul Slootman]

On Wed 31 Aug 2005, xuehai zhang wrote:

> results. Why the time of transferring the file to 2N nodes is shorter than 
> twice of the time of transferring the same file to N nodes? Does it make 

If the network is not the bottleneck, then cpu or the disks are. If
(similar) tasks are run in parallel, then the data of the files being
handled may still be in the buffer cache so that it doesn't need to get
read in from disk again. This will save time...


Paul Slootman