File walking issue?

Jim Salter jim at jrssystems.net
Mon Feb 16 22:20:10 GMT 2004


Is there anything noticeably different, network-wise, about this RH box 
from the others?  Different network card, different subnet, etc?  Can 
your other *nix machines sync from this particular Win2K smb filesystem 
fine?  Can the problem child *nix box sync to your other *nix boxen fine?


> 
>>I'm having an issue with one particular server and am hoping someone
>>here has dealt with this.
>>
>> 
>>
>>I'm not sure whether this is a strictly samba issue or relates to the
>>way rsync walks the file list.
>>
>> 
>>
>>Basically after mounting a Windows 2000 file system using and then
>>rsyncing the contents of this mount, it seems to take 5 - 8 hours to
>>complete. I've checked on the log periodically and determined that
> 
> it's
> 
>>the 'building of the file list' that is taking 95% of the time. We are
>>only talking about 140,000 files. I do many samba shares and not of
> 
> them
> 
>>have this issue. When doing a manual 'ls' command in various
> 
> directories
> 
>>on the mount, I encounter no slowness or anything out of the ordinary.
>>The samba log doesn't give much of a clue either.
>>
>> 
>>
>>Has anybody come across this? Or does anybody have any ideas of how to
>>troubleshoot?
>>
>> 
>>
>>Oh, and I'm using Rsync 2.6
> 
> 
> Max - what is the OS of the machine you're using to access the Win2K SMB
> 
> share from?  I ask because the reference implementation of Samba - ie, 
> the ftp-alike smbclient - works just dandy under every OS I've looked 
> at, but the kernel implementation of smbfs under FreeBSD (and possibly 
> other BSDs, I'm not sure) is severely broken - it will work fine for 
> small operations from an interactive prompt, but if you ask it to handle
> 
> several thousand files, it slows to an absolute crawl.  This is not an 
> rsync-samba interaction problem, it occurs even with a simple cp 
> /mnt/smbshare/* /home/whoever type command as well, if significant 
> numbers of files are involved.
> 
> Hope this helps.
> 
> ------------------------------------------------------
> 
> I'm actually using RedHat 9 with Samba 2.2.8a. 3.0 was giving me a
> slight  issue with hanging on the mount command.
> 
> I've got this same basic setup on several servers but this is the only
> one giving me this issue. I have one that does 130,000 from a samba
> mount that takes 8 minutes for both the 'file walk' and the actual
> syncing of files.
> 
> I've tried a -vv and it doesn't show much of interest. I may try a
> triple v.
> 
> Thanks,
> Max
> 



More information about the rsync mailing list