Stale smbd processes with Samba4 as AD Domain Controller
Morten Kramer
node1011 at googlemail.com
Mon Jul 2 09:55:29 MDT 2012
Hi,
I'm running Samba4 as an Domain Controller.
The other day, i was logging into one of our servers via RDP and noticed
that it would hang at the Welcome screen (windows 2008).
I looked on the server, and there were about 100 smbd processes. I had
to kill samba and the smbd processes.
This is from the samba.log:
[2012/06/29 17:03:17.561032, 0]
../source4/lib/messaging/messaging.c:633(imessaging_init)
Unable to setup messaging listener for
'/usr/local/samba/private/smbd.tmp/msg/msg.6649.2':NT_STATUS_ACCESS_DENIED
[2012/06/29 17:03:17.561310, 0]
../source3/rpc_server/dcesrv_auth_generic.c:40(auth_generic_server_authtype_start)
../source3/rpc_server/dcesrv_auth_generic.c:40: auth_generic_prepare
failed: NT_STATUS_INVALID_SERVER_STATE
[2012/06/29 17:03:17.561503, 0]
../source3/rpc_server/srv_pipe.c:553(pipe_auth_generic_bind)
../source3/rpc_server/srv_pipe.c:553:
auth_generic_server_authtype_start failed: NT_STATUS_INVALID_SERVER_STATE
[2012/06/30 21:54:32.370218, 0]
../source4/lib/messaging/messaging.c:633(imessaging_init)
Unable to setup messaging listener for
'/usr/local/samba/private/smbd.tmp/msg/msg.2801.2':NT_STATUS_ACCESS_DENIED
[2012/06/30 21:54:32.370507, 0]
../source3/rpc_server/dcesrv_auth_generic.c:40(auth_generic_server_authtype_start)
../source3/rpc_server/dcesrv_auth_generic.c:40: auth_generic_prepare
failed: NT_STATUS_INVALID_SERVER_STATE
[2012/06/30 21:54:32.370677, 0]
../source3/rpc_server/srv_pipe.c:553(pipe_auth_generic_bind)
../source3/rpc_server/srv_pipe.c:553:
auth_generic_server_authtype_start failed: NT_STATUS_INVALID_SERVER_STATE
[2012/07/01 12:27:25.260257, 0]
../source3/smbd/oplock.c:333(oplock_timeout_handler)
Oplock break failed for file
aeriagames.local/Policies/{31B2F340-016D-11D2-945F-00C04FB984F9}/GPT.INI
-- replying anyway
[2012/07/01 12:27:25.296902, 0] ../source3/lib/util.c:863(smb_panic_s3)
PANIC (pid 16283): Got a deferred entry without a request: PANIC:
share_mode_entry[1]: pid = 16283, share_access = 0x0, private_options =
0x0, access_mask = 0x0, mid = 0x6, type= 0x20, gen_id = 0, uid =
4294967295, flags = 0, file_id fd00:43e63:0, name_hash = 0x0
[2012/07/01 12:27:25.349957, 0] ../source3/lib/util.c:974(log_stack_trace)
BACKTRACE: 27 stack frames:
#0 /usr/local/samba/lib/libsmbconf.so.0(log_stack_trace+0x1f)
[0x7ff7feaf998b]
#1 /usr/local/samba/lib/libsmbconf.so.0(smb_panic_s3+0x6d)
[0x7ff7feaf9809]
#2 /usr/local/samba/lib/libsamba-util.so.0(smb_panic+0x28)
[0x7ff80090f812]
#3 /usr/local/samba/lib/private/libsmbd_base.so(+0x123145)
[0x7ff8000b3145]
#4 /usr/local/samba/lib/private/libsmbd_base.so(+0x123465)
[0x7ff8000b3465]
#5 /usr/local/samba/lib/private/libsmbd_base.so(+0x125bee)
[0x7ff8000b5bee]
#6 /usr/local/samba/lib/private/libsmbd_base.so(+0x129476)
[0x7ff8000b9476]
#7
/usr/local/samba/lib/private/libsmbd_base.so(create_file_default+0x2f8)
[0x7ff8000b9fa7]
#8 /usr/local/samba/lib/private/libsmbd_base.so(+0x235d97)
[0x7ff8001c5d97]
#9
/usr/local/samba/lib/private/libsmbd_base.so(smb_vfs_call_create_file+0xcb)
[0x7ff8000c53f5]
#10 /usr/local/samba/lib/private/libsmbd_base.so(+0x1701ce)
[0x7ff8001001ce]
#11
/usr/local/samba/lib/private/libsmbd_base.so(smbd_smb2_request_process_create+0x7ac)
[0x7ff8000fe268]
#12
/usr/local/samba/lib/private/libsmbd_base.so(smbd_smb2_request_dispatch+0x6fe)
[0x7ff8000f64cd]
#13 /usr/local/samba/lib/private/libsmbd_base.so(+0x1711de)
[0x7ff8001011de]
#14
/usr/local/samba/lib/private/libtevent.so.0(tevent_common_loop_immediate+0x1f9)
[0x7ff7fed62c70]
#15 /usr/local/samba/lib/libsmbconf.so.0(run_events_poll+0x57)
[0x7ff7feb159eb]
#16 /usr/local/samba/lib/libsmbconf.so.0(+0x4226e) [0x7ff7feb1626e]
#17
/usr/local/samba/lib/private/libtevent.so.0(_tevent_loop_once+0xe8)
[0x7ff7fed61d6f]
#18
/usr/local/samba/lib/private/libsmbd_base.so(smbd_process+0x10ed)
[0x7ff8000e0971]
#19 /usr/local/samba/sbin/smbd() [0x409524]
#20 /usr/local/samba/lib/libsmbconf.so.0(run_events_poll+0x71a)
[0x7ff7feb160ae]
#21 /usr/local/samba/lib/libsmbconf.so.0(+0x4234e) [0x7ff7feb1634e]
#22
/usr/local/samba/lib/private/libtevent.so.0(_tevent_loop_once+0xe8)
[0x7ff7fed61d6f]
#23 /usr/local/samba/sbin/smbd() [0x40a114]
#24 /usr/local/samba/sbin/smbd(main+0x1492) [0x40b6f7]
#25 /lib64/libc.so.6(__libc_start_main+0xfd) [0x7ff7fd3d6cdd]
#26 /usr/local/samba/sbin/smbd() [0x405239]
[2012/07/01 12:27:25.352573, 0] ../source3/lib/util.c:875(smb_panic_s3)
smb_panic(): calling panic action [/bin/sleep 999999999]
[2012/07/01 12:31:57.493852, 0]
../source3/lib/popt_common.c:67(popt_s3_talloc_log_fn)
talloc: access after free error - first free may be at
../source3/smbd/server_exit.c:195
[2012/07/01 12:31:57.494285, 0]
../source3/lib/popt_common.c:67(popt_s3_talloc_log_fn)
Bad talloc magic value - access after free
[2012/07/01 12:31:57.494455, 0] ../source3/lib/util.c:863(smb_panic_s3)
PANIC (pid 16349): Bad talloc magic value - access after free
[2012/07/01 12:31:57.496002, 0] ../source3/lib/util.c:974(log_stack_trace)
BACKTRACE: 41 stack frames:
#0 /usr/local/samba/lib/libsmbconf.so.0(log_stack_trace+0x1f)
[0x7ff7feaf998b]
#1 /usr/local/samba/lib/libsmbconf.so.0(smb_panic_s3+0x6d)
[0x7ff7feaf9809]
#2 /usr/local/samba/lib/libsamba-util.so.0(smb_panic+0x28)
[0x7ff80090f812]
#3 /usr/local/samba/lib/private/libtalloc.so.2(+0x1fc9) [0x7ff7ffd89fc9]
#4 /usr/local/samba/lib/private/libtalloc.so.2(+0x2045) [0x7ff7ffd8a045]
#5 /usr/local/samba/lib/private/libtalloc.so.2(+0x20c3) [0x7ff7ffd8a0c3]
#6 /usr/local/samba/lib/private/libtalloc.so.2(_talloc_free+0x36)
[0x7ff7ffd8bfd6]
#7 /usr/local/samba/lib/private/libsmbd_base.so(+0x16bcd5)
[0x7ff8000fbcd5]
#8 /usr/local/samba/lib/private/libtalloc.so.2(+0x2bdc) [0x7ff7ffd8abdc]
#9 /usr/local/samba/lib/private/libtalloc.so.2(+0x3ca9) [0x7ff7ffd8bca9]
#10 /usr/local/samba/lib/private/libtalloc.so.2(+0x2d7f)
[0x7ff7ffd8ad7f]
#11 /usr/local/samba/lib/private/libtalloc.so.2(+0x3ca9)
[0x7ff7ffd8bca9]
#12 /usr/local/samba/lib/private/libtalloc.so.2(+0x2d7f)
[0x7ff7ffd8ad7f]
#13 /usr/local/samba/lib/private/libtalloc.so.2(+0x3ca9)
[0x7ff7ffd8bca9]
#14 /usr/local/samba/lib/private/libtalloc.so.2(+0x2d7f)
[0x7ff7ffd8ad7f]
#15 /usr/local/samba/lib/private/libtalloc.so.2(+0x3ca9)
[0x7ff7ffd8bca9]
#16 /usr/local/samba/lib/private/libtalloc.so.2(+0x2d7f)
[0x7ff7ffd8ad7f]
#17 /usr/local/samba/lib/private/libtalloc.so.2(+0x3ca9)
[0x7ff7ffd8bca9]
#18 /usr/local/samba/lib/private/libtalloc.so.2(+0x2d7f)
[0x7ff7ffd8ad7f]
#19 /usr/local/samba/lib/private/libtalloc.so.2(+0x3ca9)
[0x7ff7ffd8bca9]
#20 /usr/local/samba/lib/private/libtalloc.so.2(+0x2d7f)
[0x7ff7ffd8ad7f]
#21 /usr/local/samba/lib/private/libtalloc.so.2(_talloc_free+0x102)
[0x7ff7ffd8c0a2]
#22 /usr/local/samba/lib/private/libsmbd_base.so(+0x18990b)
[0x7ff80011990b]
#23 /usr/local/samba/lib/private/libsmbd_base.so(+0x189b2b)
[0x7ff800119b2b]
#24 /usr/local/samba/sbin/smbd() [0x40821f]
#25
/usr/local/samba/lib/libsmbconf.so.0(messaging_dispatch_rec+0x87)
[0x7ff7feb027a3]
#26 /usr/local/samba/lib/libsmbconf.so.0(+0x2fc35) [0x7ff7feb03c35]
#27 /usr/local/samba/lib/libsmbconf.so.0(+0x2e86e) [0x7ff7feb0286e]
#28
/usr/local/samba/lib/private/libtevent.so.0(tevent_common_check_signal+0x21b)
[0x7ff7fed65a61]
#29 /usr/local/samba/lib/libsmbconf.so.0(run_events_poll+0x30)
[0x7ff7feb159c4]
#30 /usr/local/samba/lib/libsmbconf.so.0(+0x4226e) [0x7ff7feb1626e]
#31
/usr/local/samba/lib/private/libtevent.so.0(_tevent_loop_once+0xe8)
[0x7ff7fed61d6f]
#32
/usr/local/samba/lib/private/libsmbd_base.so(smbd_process+0x10ed)
[0x7ff8000e0971]
#33 /usr/local/samba/sbin/smbd() [0x409524]
#34 /usr/local/samba/lib/libsmbconf.so.0(run_events_poll+0x71a)
[0x7ff7feb160ae]
#35 /usr/local/samba/lib/libsmbconf.so.0(+0x4234e) [0x7ff7feb1634e]
#36
/usr/local/samba/lib/private/libtevent.so.0(_tevent_loop_once+0xe8)
[0x7ff7fed61d6f]
#37 /usr/local/samba/sbin/smbd() [0x40a114]
#38 /usr/local/samba/sbin/smbd(main+0x1492) [0x40b6f7]
#39 /lib64/libc.so.6(__libc_start_main+0xfd) [0x7ff7fd3d6cdd]
#40 /usr/local/samba/sbin/smbd() [0x405239]
After removing the smbd pid file and killing off all the sleep 99999999,
it would work again and server login works fine.
I updated to the latest git (5days newer). Not sure if it was fixed.
At the moment it looks like this:
root 6850 0.0 0.8 544600 34032 ? S 13:04 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
root 6853 0.0 0.8 544600 34024 ? S 13:04 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
root 8604 0.0 0.8 544600 34436 ? S 16:11 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
root 8606 0.0 0.8 544600 34416 ? S 16:11 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
root 8634 0.0 0.8 544600 34396 ? S 16:14 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
root 8735 0.0 0.8 544600 34416 ? S 16:26 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
root 8947 0.0 0.8 544600 34356 ? S 16:53 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
root 9194 0.1 1.0 542776 42028 ? S 17:20 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
3000171 9255 2.6 0.8 544584 34180 ? S 17:27 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
root 9256 3.0 0.0 110216 1156 pts/0 R+ 17:27 0:00 ps aux
root 21190 0.0 0.0 0 0 ? S Jul01 0:00 [bluetooth]
root 21936 0.0 1.0 466196 39948 ? Ss Jul01 0:00 ./samba
root 21937 0.0 0.7 466196 28284 ? S Jul01 0:00 ./samba
root 21938 2.3 1.6 471028 64300 ? S Jul01 33:21 ./samba
root 21939 0.1 1.0 530356 41884 ? Ss Jul01 1:30
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
root 21940 0.0 1.2 487496 47936 ? S Jul01 0:34 ./samba
root 21941 0.0 0.7 466196 28180 ? S Jul01 0:00 ./samba
root 21943 0.2 1.7 466708 69144 ? S Jul01 3:45 ./samba
root 21944 0.0 1.6 499752 64100 ? S Jul01 0:39 ./samba
root 21945 0.1 1.1 470604 44332 ? S Jul01 1:25 ./samba
root 21946 0.1 0.7 466196 29912 ? S Jul01 2:10 ./samba
root 21947 0.0 0.7 469024 29792 ? S Jul01 0:24 ./samba
root 21948 0.0 0.7 466196 28308 ? S Jul01 0:00 ./samba
root 21949 2.2 2.1 494020 85912 ? S Jul01 31:00 ./samba
root 21950 0.4 0.9 466356 36592 ? S Jul01 5:52 ./samba
root 21951 0.1 1.6 470504 67008 ? S Jul01 1:58 ./samba
root 22011 0.0 0.8 544600 34044 ? S Jul01 0:00
/usr/local/samba/sbin/smbd --configfile
/usr/local/samba/private/smbd.tmp/fileserver.conf --foreground
There are already smbd processes started at 13:04, about 5hours ago.
Are this normal? How can i debug if there is something odd going on?
Thanks,
Morten
More information about the samba-technical
mailing list