Long time needed for "Building file list" Any suggestions ?

Mark Thornton mark.p.thornton at ntlworld.com
Mon Mar 22 21:44:22 GMT 2004


Clint Byrum wrote:

>This does bring up one point though. Is there any way to optimize file
>list building? It seems like that turns into a huge bottleneck in the
>"lots of files" situation.
>  
>
Only by having a process which continuously monitors the relevant 
directory trees to maintain a list of the changed files.
In the case of Windows perhaps using the ReadDirectoryChangesW method.
http://msdn.microsoft.com/library/en-us/fileio/base/readdirectorychangesw.asp?frame=true

Otherwise scanning a large directory tree for changes is unavoidably 
slow. (At least it is only quick if you have very recently scanned the 
same tree and thus have all the directory data cached in memory.)

Mark Thornton




More information about the rsync mailing list