reducing I/O and system load
Denis Solovyov
elk at elk.ru
Fri Feb 17 09:05:40 GMT 2006
>> > I'm using rsync for simple daily back up data from one HD to another. It
>> > takes about 10 minutes daily under "nice -n 19". The problem is
>> > well-known as I see - several other services such as httpd or mysql
>> > begin responding slowly (up to 10 sec for mysql queries which usually
>> > processed in a small fraction of a second).
>> --bwlimit=KBPS limit I/O bandwidth; KBytes per second
MM> --bwlimit only limits the rate of transfer over the network. Vilius
MM> Puidokas encountered the same problem and traced it to the scanning as
MM> rsync generates the file list. He wrote a patch that adds a --slow-down
MM> option that makes rsync wait a few microseconds in between scanning each
MM> file. Find it here:
MM> http://vilius.multiply.com/video/item/10
usleep(100) in that place of the source shown on the page really helps,
but it dramatically increases the time of rsync'ing. I guess Vilius'
supposition that usleep(100) for 10k of dirs is 10 sec is a bit wrong,
it seems to be not a simple multiplication.
Best regards,
Denis Solovyov
More information about the rsync
mailing list