No subject


Tue Dec 2 04:10:01 GMT 2003


1     /etc/init -
  190   /usr/sbin/inetd -s
    6892  smbd


"Romeril, Alan" wrote:
> 
> Okay just had a little issue with this again....
> Users complaining of messages like "The Semaphore Timeout has Expired"
> when trying to map a drive,
> The machine was running over 500 smbds, but that`s a normal load.  This
> time however whatever was going on stopped by itself after a little
> while but I grabbed this..
> 
> dkb:bash-2.04#pinsp 6881
> From pfiles...
> 
> 6881:  smbd
>   Current rlimit: 1010 file descriptors
>    0: S_IFCHR mode:0666 dev:136,0 ino:121149 uid:0 gid:3 rdev:13,2
>       O_RDWR|O_LARGEFILE
>    1: S_IFCHR mode:0666 dev:136,0 ino:121149 uid:0 gid:3 rdev:13,2
>       O_RDWR|O_LARGEFILE
>    2: S_IFCHR mode:0666 dev:136,0 ino:121149 uid:0 gid:3 rdev:13,2
>       O_RDWR|O_LARGEFILE
>    3: S_IFDOOR mode:0444 dev:188,0 ino:45387 uid:0 gid:0 size:0
>       O_RDONLY|O_LARGEFILE FD_CLOEXEC  door to nscd[865]
>    4: S_IFCHR mode:0000 dev:136,0 ino:47176 uid:0 gid:0 rdev:41,259
>       O_RDWR FD_CLOEXEC
>    5: S_IFREG mode:0600 dev:136,3 ino:93746 uid:0 gid:0 size:8192
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27918
>    6: S_IFREG mode:0600 dev:136,3 ino:97709 uid:0 gid:0 size:696
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27918
>    7: S_IFREG mode:0644 dev:136,3 ino:97710 uid:0 gid:0 size:696320
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27918
>    8: S_IFSOCK mode:0666 dev:183,0 ino:52340 uid:0 gid:0 size:0
>       O_RDWR
>  sockname: AF_INET 155.198.44.51  port: 139
>  peername: AF_INET 129.31.13.36  port: 1031
>    9: S_IFREG mode:0644 dev:136,3 ino:97711 uid:0 gid:0 size:32768
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27875
>   10: S_IFREG mode:0644 dev:136,3 ino:97602 uid:0 gid:0 size:622592
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27796
>   11: S_IFREG mode:0600 dev:136,3 ino:97713 uid:0 gid:0 size:8192
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27796
>   12: S_IFREG mode:0600 dev:136,3 ino:97714 uid:0 gid:0 size:8192
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27796
>   13: S_IFREG mode:0600 dev:136,3 ino:97715 uid:0 gid:0 size:696
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27796
>   14: S_IFREG mode:0600 dev:136,3 ino:97716 uid:0 gid:0 size:696
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27796
>   15: S_IFREG mode:0600 dev:136,3 ino:97717 uid:0 gid:0 size:8192
>       O_RDWR|O_LARGEFILE
>       advisory read lock set by process 27796
>   16: S_IFSOCK mode:0666 dev:183,0 ino:52348 uid:0 gid:0 size:0
>       O_RDWR
>  sockname: AF_INET 127.0.0.1  port: 59366
>   17: S_IFIFO mode:0000 dev:184,0 ino:1252026 uid:0 gid:0 size:0
>       O_RDWR|O_NONBLOCK
>   18: S_IFIFO mode:0000 dev:184,0 ino:1252026 uid:0 gid:0 size:0
>       O_RDWR|O_NONBLOCK
>   19: S_IFREG mode:0644 dev:136,3 ino:43579 uid:0 gid:0 size:15708
>       O_WRONLY|O_APPEND|O_LARGEFILE
>   20: S_IFREG mode:0700 dev:85,0 ino:15264139 uid:61534 gid:7108 size:0
>       O_RDWR|O_NONBLOCK|O_LARGEFILE
>   21: S_IFREG mode:0700 dev:85,0 ino:192175 uid:61534 gid:7108
> size:81920
>       O_RDWR|O_NONBLOCK|O_LARGEFILE
>   22: S_IFREG mode:0700 dev:85,0 ino:192242 uid:61534 gid:7108 size:104
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   23: S_IFREG mode:0700 dev:85,0 ino:192243 uid:61534 gid:7108 size:112
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   24: S_IFREG mode:0700 dev:85,0 ino:192097 uid:61534 gid:7108 size:158
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   25: S_IFREG mode:0700 dev:85,0 ino:192245 uid:61534 gid:7108 size:111
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   26: S_IFREG mode:0700 dev:85,0 ino:192246 uid:61534 gid:7108 size:99
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   27: S_IFREG mode:0700 dev:85,0 ino:192247 uid:61534 gid:7108 size:102
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   28: S_IFREG mode:0700 dev:85,0 ino:192248 uid:61534 gid:7108 size:109
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   29: S_IFREG mode:0700 dev:85,0 ino:192249 uid:61534 gid:7108 size:218
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   30: S_IFREG mode:0700 dev:85,0 ino:192250 uid:61534 gid:7108 size:157
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   31: S_IFREG mode:0700 dev:85,0 ino:192251 uid:61534 gid:7108 size:92
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   32: S_IFREG mode:0700 dev:85,0 ino:192252 uid:61534 gid:7108 size:73
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   33: S_IFREG mode:0700 dev:85,0 ino:192253 uid:61534 gid:7108 size:328
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   34: S_IFREG mode:0700 dev:85,0 ino:192254 uid:61534 gid:7108 size:78
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   35: S_IFREG mode:0700 dev:85,0 ino:192255 uid:61534 gid:7108 size:310
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   36: S_IFREG mode:0700 dev:85,0 ino:192256 uid:61534 gid:7108 size:78
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   37: S_IFREG mode:0700 dev:85,0 ino:192257 uid:61534 gid:7108 size:152
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   38: S_IFREG mode:0700 dev:85,0 ino:192258 uid:61534 gid:7108 size:79
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   39: S_IFREG mode:0700 dev:85,0 ino:192259 uid:61534 gid:7108 size:1645
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   40: S_IFREG mode:0700 dev:85,0 ino:192260 uid:61534 gid:7108 size:105
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   41: S_IFREG mode:0700 dev:85,0 ino:192261 uid:61534 gid:7108 size:86
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   42: S_IFREG mode:0700 dev:85,0 ino:192262 uid:61534 gid:7108 size:86
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   43: S_IFREG mode:0700 dev:85,0 ino:192263 uid:61534 gid:7108 size:85
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   44: S_IFREG mode:0700 dev:85,0 ino:192264 uid:61534 gid:7108 size:211
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   45: S_IFREG mode:0700 dev:85,0 ino:192265 uid:61534 gid:7108 size:87
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   46: S_IFREG mode:0700 dev:85,0 ino:192267 uid:61534 gid:7108 size:86
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   47: S_IFREG mode:0700 dev:85,0 ino:192268 uid:61534 gid:7108 size:69
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   48: S_IFREG mode:0700 dev:85,0 ino:192269 uid:61534 gid:7108 size:123
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   49: S_IFREG mode:0700 dev:85,0 ino:192333 uid:61534 gid:7108 size:88
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   50: S_IFREG mode:0700 dev:85,0 ino:192270 uid:61534 gid:7108 size:77
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   51: S_IFREG mode:0700 dev:85,0 ino:192271 uid:61534 gid:7108 size:92
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   52: S_IFREG mode:0700 dev:85,0 ino:192103 uid:61534 gid:7108 size:79
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   53: S_IFREG mode:0700 dev:85,0 ino:192273 uid:61534 gid:7108 size:91
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   54: S_IFREG mode:0700 dev:85,0 ino:192274 uid:61534 gid:7108 size:101
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   55: S_IFREG mode:0700 dev:85,0 ino:192275 uid:61534 gid:7108 size:172
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   56: S_IFREG mode:0700 dev:85,0 ino:192276 uid:61534 gid:7108 size:110
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   57: S_IFREG mode:0700 dev:85,0 ino:192277 uid:61534 gid:7108 size:81
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   58: S_IFREG mode:0700 dev:85,0 ino:192278 uid:61534 gid:7108 size:85
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   59: S_IFREG mode:0700 dev:85,0 ino:192279 uid:61534 gid:7108 size:82
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   60: S_IFREG mode:0700 dev:85,0 ino:192280 uid:61534 gid:7108 size:72
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   61: S_IFREG mode:0700 dev:85,0 ino:192281 uid:61534 gid:7108 size:124
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   62: S_IFREG mode:0700 dev:85,0 ino:192282 uid:61534 gid:7108 size:174
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   63: S_IFREG mode:0700 dev:85,0 ino:192283 uid:61534 gid:7108 size:107
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   64: S_IFREG mode:0700 dev:85,0 ino:192284 uid:61534 gid:7108 size:97
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   65: S_IFREG mode:0700 dev:85,0 ino:192285 uid:61534 gid:7108 size:86
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
>   66: S_IFREG mode:0700 dev:85,0 ino:192241 uid:61534 gid:7108 size:855
>       O_RDONLY|O_NONBLOCK|O_LARGEFILE
> 
> From pstack...
> 
> 6881:  smbd
>  ff21630c __fcntl  (a, 22, 22, ffbef248, 215a8, 115aac) + c
>  00115aac tdb_brlock (1ce6c8, 4f2c4, 3, 22, 0, 116f2c) + 60
>  001173e0 write_unlock_record (1ce6c8, 4f2c4, 399de24c, ffbef3f0, 21dc0,
> ff1c0d48) + 14
>  001174ac do_delete (1ce6c8, 4f2c4, ffbef3f0, ffbef3f0, 0, 26cea8) + 50
>  00117b00 tdb_delete (ffbef3f0, ffbef480, 1a4b58, ffbef480, 0, 2eef1) +
> 3c
>  000e9f94 del_share_entry (0, 1, 2eef1, ffbef500, ffbef59c, 2eef1) + 200
>  000ea044 del_share_mode (26d5e0, ffbef59c, 0, 0, 63007a68, 63000000) +
> 2c
>  00061a30 close_normal_file (26d5e0, 1, 0, 4, 74, ffbef680) + 64
>  00061df0 close_file (26d5e0, 1, 3ff, 19ec00, 0, 221da1) + 30
>  000502b0 reply_close (26d908, 211931, 221d79, 2e, f000, 50120) + 190
>  0006b18c switch_message (4, 211931, 221d79, 2e, f000, 2119bd) + 514
>  0006b218 construct_reply (211931, 221d79, 2e, f000, 0, ffbefbe1) + 60
>  0006b4c4 process_smb (211931, 221d79, ea60, 1, 0, 0) + 1bc
>  0006bec4 smbd_process (1, 8b, 186a0, 1, ff238fbc, 128ca0) + 134
>  0002efe0 main     (0, ffbefd3c, ffbefd44, 1b7e08, 0, 0) + 7a8
>  0002d8d0 _start   (0, 0, 0, 0, 0, 0) + 5c
> 
> From pmap...
> 
> 6881:  smbd
>  Address   Kbytes Resident Shared Private Permissions       Mapped File
> 00010000    1384    1192    1184       8 read/exec         smbd
> 00178000     160     160      88      72 read/write/exec   smbd
> 001A0000    1024     456       -     456 read/write/exec     [ heap ]
> FEF60000      24      24      16       8 read/exec         nss_nis.so.1
> FEF76000       8       8       -       8 read/write/exec   nss_nis.so.1
> FEF80000     608     608     608       - read/write/shared dev:136,3
> ino:97602
> FF020000       8       8       -       8 read/write/exec     [ anon ]
> FF030000      24      24      16       8 read/exec
> nss_files.so.1
> FF046000       8       8       -       8 read/write/exec
> nss_files.so.1
> FF060000       8       8       8       - read/write/shared dev:136,3
> ino:97717
> FF070000       8       8       -       8 read/write/shared dev:136,3
> ino:97716
> FF080000     672     672     672       - read/write/shared dev:136,3
> ino:97710
> FF130000       8       8       -       8 read/write/shared dev:136,3
> ino:97715
> FF140000       8       8       8       - read/write/shared dev:136,3
> ino:97714
> FF150000       8       8       8       - read/write/shared dev:136,3
> ino:97713
> FF160000      32      32      32       - read/write/shared dev:136,3
> ino:97711
> FF170000       8       8       -       8 read/write/shared dev:136,3
> ino:97709
> FF180000     664     664     592      72 read/exec         libc.so.1
> FF236000      24      24       -      24 read/write/exec   libc.so.1
> FF23C000       8       8       -       8 read/write/exec   libc.so.1
> FF250000      16      16       8       8 read/exec         libc_psr.so.1
> FF260000      16      16       8       8 read/exec         libmp.so.2
> FF274000       8       8       -       8 read/write/exec   libmp.so.2
> FF280000     552     552     488      64 read/exec         libnsl.so.1
> FF31A000      32      32       -      32 read/write/exec   libnsl.so.1
> FF322000      32       -       -       - read/write/exec   libnsl.so.1
> FF330000       8       8       8       - read/write/shared dev:136,3
> ino:93746
> FF340000      40      40      32       8 read/exec
> libsocket.so.1
> FF35A000       8       8       -       8 read/write/exec
> libsocket.so.1
> FF360000      24      24      16       8 read/exec         libgen.so.1
> FF376000       8       8       -       8 read/write/exec   libgen.so.1
> FF380000       8       8       -       8 read/write/exec     [ anon ]
> FF390000      16      16       8       8 read/exec         libsec.so.1
> FF3A4000       8       8       -       8 read/write/exec   libsec.so.1
> FF3B0000       8       8       -       8 read/exec         libdl.so.1
> FF3C0000     128     128     120       8 read/exec         ld.so.1
> FF3E0000       8       8       -       8 read/write/exec   ld.so.1
> FFBE8000      32      16       -      16 read/write/exec     [ stack ]
> --------  ------  ------  ------  ------
> total Kb    5648    4840    3920     920
> 
> From ptree...
> 
> 1     /etc/init -
>   190   /usr/sbin/inetd -s
>     6881  smbd
> "Romeril, Alan" wrote:
> >
> > Okay, I`ll give it a go when the machine next does this, it might not be
> > for a while as it won`t be busy enough over the Christmas break.
> > And I doubt there will be enough time to catch one of the rouges in the
> > act as several smbds are doing this and most of these die by the time I
> > can attach a truss...
> >
> > David Collier-Brown wrote:
> > >
> > > Jeremy Allison wrote:
> > > >
> > > > On Fri, Dec 21, 2001 at 11:54:54AM +0000, Romeril, Alan wrote:
> > > >
> > > > > Also the fcntl F_SETLKW64 bug is still there I have just had to pkill
> > > > > the smbds AGAIN as the load ave hit 50.
> > > > > machine:bash-2.04#truss -p 13162
> > > > > fcntl(7, F_SETLKW64, 0xFFBEF7B0)                = 0
> > > > > fcntl(7, F_SETLKW64, 0xFFBEF7B0)                = 0
> > > > > fcntl(7, F_SETLKW64, 0xFFBEF7B0)                = 0
> > > > > fcntl(7, F_SETLKW64, 0xFFBEF820)                = 0
> > > > > kill(29956, SIG#0)                              = 0
> > > > > fcntl(7, F_SETLKW64, 0xFFBEF7B0)                = 0
> > > > > fcntl(7, F_SETLKW64, 0xFFBEF7B0)                = 0
> > > > > fcntl(7, F_SETLKW64, 0xFFBEF7B0)                = 0
> > > > > fcntl(7, F_SETLKW64, 0xFFBEF820)                = 0
> > > > > fcntl(7, F_SETLKW64, 0xFFBEF7B0)                = 0
> > > > >
> > > > > again yes Solaris 8, on an Ultra
> > > >
> > > > Can you get a backtrace when it's in that state so I can see
> > > > what smbd is doing ?
> > >
> > > To get all the interesting data, try
> > >         pstack <pid>            -- get a stack traceback
> > > and then,
> > >         pfiles  <pid>           -- find out what fiels/sockets
> > >         pmap -x <pid>           -- memory map
> > > and
> > >         ptree -a <pid>          -- process tree
> > >
> > > --dave
> > >
> > > --
> > > David Collier-Brown,           | Always do right. This will gratify
> > > Americas Customer Engineering, | some people and astonish the rest.
> > > SunPS Integration Services.    |                      -- Mark Twain
> > > (905) 415-2849                 | davecb at canada.sun.com




More information about the samba-technical mailing list