DO NOT REPLY [Bug 3491] throttle disk IO during filelist/directory parsing

samba-bugs at samba.org samba-bugs at samba.org
Thu Aug 19 06:26:27 MDT 2010


https://bugzilla.samba.org/show_bug.cgi?id=3491


andy at haveland.com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |andy at haveland.com




------- Comment #4 from andy at haveland.com  2010-08-19 07:26 CST -------
Is rsync still being maintained?

I support this feature too, and the ability to request that the sender does not
cache files.

My webserver is a social networking site, and has a deep hierarchy of image
files eg, ~/999/999/999/file.jpg with a parallel tree for server generated
thumbnails. This is located on a separate device from the main system
(reiserfs,noatime of course!).

Rsync is amazing - I use it to back up the server over cable, but the problem
is that scanning 50Gb of files in 300,000+ directories hits the server hard,
takes a long time, and saturates linux's cache with files that will rarely be
used.

The option to sleep between dir reads would be useful, although this would
dramatically increase run time!

The most useful thing for me would be an option to tell rsync to tell the
kernel to leave the server's present cache untouched. Is this possible?

If not, then I think I'll have to write something to query the database and
calculate deltas from the local copy and sync on a per file basis.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.


More information about the rsync mailing list