File walking issue?
Adnan
adnano at charter.net
Wed Feb 18 17:04:03 GMT 2004
Is this true!!
Can somebody please shed some light on it
Max Kipness wrote:
>
>
>
> > I'm having an issue with one particular server and am hoping someone
> > here has dealt with this.
> >
> >
> >
> > I'm not sure whether this is a strictly samba issue or relates to the
> > way rsync walks the file list.
> >
> >
> >
> > Basically after mounting a Windows 2000 file system using and then
> > rsyncing the contents of this mount, it seems to take 5 - 8 hours to
> > complete. I've checked on the log periodically and determined that
> it's
> > the 'building of the file list' that is taking 95% of the time. We are
> > only talking about 140,000 files. I do many samba shares and not of
> them
> > have this issue. When doing a manual 'ls' command in various
> directories
> > on the mount, I encounter no slowness or anything out of the ordinary.
> > The samba log doesn't give much of a clue either.
> >
> >
> >
> > Has anybody come across this? Or does anybody have any ideas of how to
> > troubleshoot?
> >
> >
> >
> > Oh, and I'm using Rsync 2.6
>
> Max - what is the OS of the machine you're using to access the Win2K SMB
>
> share from? I ask because the reference implementation of Samba - ie,
> the ftp-alike smbclient - works just dandy under every OS I've looked
> at, but the kernel implementation of smbfs under FreeBSD (and possibly
> other BSDs, I'm not sure) is severely broken - it will work fine for
> small operations from an interactive prompt, but if you ask it to handle
>
> several thousand files, it slows to an absolute crawl. This is not an
> rsync-samba interaction problem, it occurs even with a simple cp
> /mnt/smbshare/* /home/whoever type command as well, if significant
> numbers of files are involved.
>
> Hope this helps.
>
> ------------------------------------------------------
>
> I'm actually using RedHat 9 with Samba 2.2.8a. 3.0 was giving me a
> slight issue with hanging on the mount command.
>
> I've got this same basic setup on several servers but this is the only
> one giving me this issue. I have one that does 130,000 from a samba
> mount that takes 8 minutes for both the 'file walk' and the actual
> syncing of files.
>
> I've tried a -vv and it doesn't show much of interest. I may try a
> triple v.
>
> Thanks,
> Max
>
>
More information about the rsync
mailing list