How much file list kept during incremental recursion?
wayned at samba.org
Fri Aug 3 00:16:46 GMT 2007
On Thu, Aug 02, 2007 at 11:20:09AM -0400, Matt McCutchen wrote:
> How much of the file list do the rsync processes hold in memory at any
> one time in incremental recursion mode?
It currently stores all directores that are encountered during the run
(though this might be optimized away in the future). It also pre-loads
around 1000 files (if there are that many left) in order to try to give
the generator plenty of items to scan during the time it might take a
large file transfer to complete. It will also have the recent file info
from any already scanned directories that have in-progress transfers.
When a directory's contents are no longer needed, the associated file
info is discarded by all 3 programs.
Rsync does read whole directories at a time, so if there are directories
with more than 1000 items in them, rsync's reading ahead of future files
can be larger than normal.
More information about the rsync