[Samba] Clustered Samba: smbd process deadlocks when doing an /etc/init.d/samba stop on gentoo

[erik bergsma]

Hi All,

i have a problem with the SMBD processes on my clustered Samba setup.
The setup contains:
- 2  gentoo linux nodes (kernel 2.6.33.2)
- ctdb 1.0.114_p1
- samba 3.5.8
- glusterfs 2.0.8

sometimes i want to do some maitenance on one of the nodes, then i do
the following:
- /etc/init.d/samba stop (to stop samba, and move all the users to the
other nodes)
- /etc/iniit.d/ctdb stop (to move the floating ip to the other host)

After the first command, i see a big decline in the amount of smbd
processes; from ~45 to ~15.
but after 45 seconds the number stays the same, and after ~60 seconds
the stopping process fails;
leaving the remaining 15 processes either in S or in D state is `ps aux`

i cannot kill -9 those processes, they either switch to deadlock or
just stay deadlocked.
The only resolution i have is to do a very ugly `reboot -nfi`

so far i can provide the output of testparm, and also the relevant
logs of loglevel 1, but i have the feeling that might not be enough?

any help is very much appreciated!
Erik