File walking issue?
Jim Salter
jim at jrssystems.net
Mon Feb 16 22:20:10 GMT 2004
Is there anything noticeably different, network-wise, about this RH box
from the others? Different network card, different subnet, etc? Can
your other *nix machines sync from this particular Win2K smb filesystem
fine? Can the problem child *nix box sync to your other *nix boxen fine?
>
>>I'm having an issue with one particular server and am hoping someone
>>here has dealt with this.
>>
>>
>>
>>I'm not sure whether this is a strictly samba issue or relates to the
>>way rsync walks the file list.
>>
>>
>>
>>Basically after mounting a Windows 2000 file system using and then
>>rsyncing the contents of this mount, it seems to take 5 - 8 hours to
>>complete. I've checked on the log periodically and determined that
>
> it's
>
>>the 'building of the file list' that is taking 95% of the time. We are
>>only talking about 140,000 files. I do many samba shares and not of
>
> them
>
>>have this issue. When doing a manual 'ls' command in various
>
> directories
>
>>on the mount, I encounter no slowness or anything out of the ordinary.
>>The samba log doesn't give much of a clue either.
>>
>>
>>
>>Has anybody come across this? Or does anybody have any ideas of how to
>>troubleshoot?
>>
>>
>>
>>Oh, and I'm using Rsync 2.6
>
>
> Max - what is the OS of the machine you're using to access the Win2K SMB
>
> share from? I ask because the reference implementation of Samba - ie,
> the ftp-alike smbclient - works just dandy under every OS I've looked
> at, but the kernel implementation of smbfs under FreeBSD (and possibly
> other BSDs, I'm not sure) is severely broken - it will work fine for
> small operations from an interactive prompt, but if you ask it to handle
>
> several thousand files, it slows to an absolute crawl. This is not an
> rsync-samba interaction problem, it occurs even with a simple cp
> /mnt/smbshare/* /home/whoever type command as well, if significant
> numbers of files are involved.
>
> Hope this helps.
>
> ------------------------------------------------------
>
> I'm actually using RedHat 9 with Samba 2.2.8a. 3.0 was giving me a
> slight issue with hanging on the mount command.
>
> I've got this same basic setup on several servers but this is the only
> one giving me this issue. I have one that does 130,000 from a samba
> mount that takes 8 minutes for both the 'file walk' and the actual
> syncing of files.
>
> I've tried a -vv and it doesn't show much of interest. I may try a
> triple v.
>
> Thanks,
> Max
>
More information about the rsync
mailing list