[Samba] smbd keeps maxing out the cpu,
must reboot server constantly
Aaron Kincer
kincera at gmail.com
Fri Jan 5 20:40:33 GMT 2007
Do you have your Samba server installed on the same RAID array and/or
controller as ESX? This would be the first issue. I've got my data store
housing my Samba server on a separate external PowerVault SAS RAID 5 array.
Also, you didn't tell me what version of ESX you are running. ESX
Infrastructure 3 (what I'm running) lets you take advantage of Dual
Core/Hyperthreading. I have a Quad 2.66 Mhz Xeon with
Hyperthreading/Dual Core enabled. ESX takes full advantage of both cores
and reports 8 logical processors instead of 4.
James A. Dinkel wrote:
> Yeah, I see the brief spikes when each user connects. Those are nothing. This is a dual-Xeon 3.6Ghz server (both assigned to the Ubuntu file server vm) with 1GB of RAM assigned to this vm. It's the only vm running on this ESX server.
>
> Also top doesn't show a user smbd process maxing out the processor, it's the root smbd process.
>
> -----Original Message-----
> From: Aaron Kincer
> Sent: Friday, January 05, 2007 10:00 AM
> To: James A. Dinkel
> Cc: samba at lists.samba.org
> Subject: Re: [Samba] smbd keeps maxing out the cpu, must reboot server
> constantly
>
>
> I just watched the top for a bit and did some testing and I see brief
> spikes on my system where each domain user has their own smbd process
> that grabs resources. This seems to happen when first opening a
> directory. It would seem that whatever resources Samba needs to complete
> this operation, my server has better access to or more of so that my
> server isn't hanging. Have you watched the resources on your domain
> controllers to see if they are seeing spikes too?
>
> James A. Dinkel wrote:
>
>> This is running in vmware, and I noticed occasionally wmware reports
>> that the cpu is being maxed out by a virtual machine. Logging into the
>> virtual machine and running top confirms that the smbd process is maxing
>> out the cpu. If I leave it alone for a while, eventually it starts
>> dropping connections and not letting people into the file server.
>> Killing the process with kill -9 does no good, it just immediately comes
>> back with a new pid. Stopping the service also does no good. I have
>> to reboot the server, and occasionally even during the shutdown it will
>> hang (I left it for 30 minutes) and I have to kill the power.
>>
>> I tried collecting logs from the time the max out started. The computer
>> will run for a while, sometimes less than an hour, sometimes all day,
>> just fine, and then in less than a second the cpu goes from around 10%
>> to 100% and stays there until I reboot. But the default logs tell me
>> nothing and the level 10 logs are Greek to me.
>>
>> James Dinkel
>>
>> PS. Earlier this morning I switched to level 10 logs and when the "max
>> out" happened I checked the time in the VMWare performance graphs. It
>> looks like it happened around 9:26:40 to 9:27:20. Here are the VERY
>> LONG grep results for around that time in the logs:
>>
>> sudo grep "2007/01/04 09:26" /var/log/samba/*
>> -------------------------------------------
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>>
>> sudo grep "2007/01/04 09:27" /var/log/samba/*
>> ------------------------------------------------
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 6]
>> param/loadparm.c:lp_file_list_changed(3006)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 10]
>> smbd/process.c:setup_select_timeout(1284)
>>
>>
>>
>
>
More information about the samba
mailing list