[Samba] smbd keeps maxing out the cpu, must reboot server constantly

Aaron Kincer kincera at gmail.com
Fri Jan 5 20:46:54 GMT 2007 

Whoops. That's 2.66 ghz. Dual Core plus Hyperthreading gives 16 logical 
CPUs (8 cores hyperthreaded).

James A. Dinkel wrote:
> Yeah, I see the brief spikes when each user connects.  Those are nothing.  This is a dual-Xeon 3.6Ghz server (both assigned to the Ubuntu file server vm) with 1GB of RAM assigned to this vm.  It's the only vm running on this ESX server.
>
> Also top doesn't show a user smbd process maxing out the processor, it's the root smbd process.
>
> -----Original Message-----
> From: Aaron Kincer
> Sent: Friday, January 05, 2007 10:00 AM
> To: James A. Dinkel
> Cc: samba at lists.samba.org
> Subject: Re: [Samba] smbd keeps maxing out the cpu, must reboot server
> constantly
>
>
> I just watched the top for a bit and did some testing and I see brief 
> spikes on my system where each domain user has their own smbd process 
> that grabs resources. This seems to happen when first opening a 
> directory. It would seem that whatever resources Samba needs to complete 
> this operation, my server has better access to or more of so that my 
> server isn't hanging. Have you watched the resources on your domain 
> controllers to see if they are seeing spikes too?
>
> James A. Dinkel wrote:
>   
>> This is running in vmware, and I noticed occasionally wmware reports
>> that the cpu is being maxed out by a virtual machine.  Logging into the
>> virtual machine and running top confirms that the smbd process is maxing
>> out the cpu.  If I leave it alone for a while, eventually it starts
>> dropping connections and not letting people into the file server.
>> Killing the process with kill -9 does no good, it just immediately comes
>> back with a  new pid.  Stopping the service also does no good.  I have
>> to reboot the server, and occasionally even during the shutdown it will
>> hang (I left it for 30 minutes) and I have to kill the power.
>>
>> I tried collecting logs from the time the max out started.  The computer
>> will run for a while, sometimes less than an hour, sometimes all day,
>> just fine, and then in less than a second the cpu goes from around 10%
>> to 100% and stays there until I reboot.  But the default logs tell me
>> nothing and the level 10 logs are Greek to me.
>>
>> James Dinkel
>>
>> PS.  Earlier this morning I switched to level 10 logs and when the "max
>> out" happened I checked the time in the VMWare performance graphs.  It
>> looks like it happened around 9:26:40 to 9:27:20.  Here are the VERY
>> LONG grep results for around that time in the logs:
>>
>> sudo grep "2007/01/04 09:26" /var/log/samba/*
>> -------------------------------------------
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>> /var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
>> lib/util_sock.c:print_socket_options(206)
>>
>> sudo grep "2007/01/04 09:27" /var/log/samba/*
>> ------------------------------------------------
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 6]
>> param/loadparm.c:lp_file_list_changed(3006)
>> /var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 10]
>> smbd/process.c:setup_select_timeout(1284)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 3]
>> smbd/sec_ctx.c:set_sec_ctx(241)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 5]
>> auth/auth_util.c:debug_nt_user_token(448)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 5]
>> auth/auth_util.c:debug_unix_user_token(474)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 5]
>> smbd/uid.c:change_to_root_user(275)
>> /var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 10]
>> smbd/process.c:setup_select_timeout(1284)
>>
>>   
>>     
>
>

More information about the samba mailing list