Long time needed for "Building file list" Any suggestions ?
mark.p.thornton at ntlworld.com
Mon Mar 22 21:44:22 GMT 2004
Clint Byrum wrote:
>This does bring up one point though. Is there any way to optimize file
>list building? It seems like that turns into a huge bottleneck in the
>"lots of files" situation.
Only by having a process which continuously monitors the relevant
directory trees to maintain a list of the changed files.
In the case of Windows perhaps using the ReadDirectoryChangesW method.
Otherwise scanning a large directory tree for changes is unavoidably
slow. (At least it is only quick if you have very recently scanned the
same tree and thus have all the directory data cached in memory.)
More information about the rsync