[Samba] Samba 3.0.21a (64 Bit) dumps core when trying to join domain on Solaris 9

[Christian Walther]

Hi,

I recently tried to get Samba 3.0.21a running on Solaris 9 several
times, using different build environments. The compilers in use where
Sun Forte Version 11 and gcc 3.4.2. The binaries where compiled for 64
bit, using CFLAGS="-m64" for gcc for example. I just used

configure --prefix=<path>

The core file analysis of the latest build shows that strlen() is called:

# mdb core
Loading modules: [ libthread.so.1 libc.so.1 ld.so.1 ]

> ::status
debugging core file of net (64-bit) from vmwsol
executable file: /opt/samba-3.0.21a_sol9_64bit-2/bin/net
initial argv: ./net join -S glpls01 -P -U joindomain
threading model: multi-threaded
status: process terminated by SIGSEGV (Segmentation Fault)
> $C
ffffffff7fffe271 libc.so.1`strlen+0x7c(0, ffffffff7fffedc8, 100321970,
1003218f0, 0, 1001aa0f0)
ffffffff7fffe351 connect_to_service+0xd4(0, ffffffff7fffeddc,
100321990, 1001aa0f0, 1001aa0f8, 0)
ffffffff7fffe451 connect_to_ipc+0x3c(ffffffff7fffedc8,
ffffffff7fffeddc, 100321990, 0, 0, 0)
ffffffff7fffe511 net_make_ipc_connection+0x44(8, 0, 0, 0, 0, 0)
ffffffff7fffe5f1 net_rpc_join_newstyle+0x4c(1, 10031c300, 100320e10,
1000317a4, 81010100, ff00)
ffffffff7fffebe1 net_run_function+0x90(1, 10031c2f8, 150, 1000320c8,
10030f400, 10030f400)
ffffffff7fffeca1 main+0x340(7, ffffffff7ffffb88, 0, 1001aac00, 7, 1)
ffffffff7ffff2d1 _start+0x7c(0, 0, 0, 0, 0, 0)
> $?
no process
SIGSEGV: Segmentation Fault
%g0 = 0x0000000000000000                 %l0 = 0x0000000000000000
%g1 = 0xffffffff7e03d210 libc.so.1`strlen %l1 = 0x0000000000000000
%g2 = 0x000000010031c2f0                 %l2 = 0xffffffff7d400000
%g3 = 0x000000010031c2f0                 %l3 = 0x00000000b02f2d35
%g4 = 0x0000000000000000                 %l4 = 0x0000000000000031
%g5 = 0x0000000081fc2c00                 %l5 = 0x0000000000000030
%g6 = 0x0000000000000000                 %l6 = 0x000000007efefeff
%g7 = 0xffffffff7d400000                 %l7 = 0x0000000081010100
%o0 = 0x0000000000000000                 %i0 = 0x0000000000000000
%o1 = 0x0000000000000000                 %i1 = 0xffffffff7fffedc8
%o2 = 0x0000000100321990                 %i2 = 0x0000000100321970
%o3 = 0x000000007efefeff                 %i3 = 0x00000001003218f0
%o4 = 0x0000000081010100                 %i4 = 0x0000000000000000
%o5 = 0xffffffffffffffff                 %i5 = 0x00000001001aa0f0
%o6 = 0xffffffff7fffe271                 %i6 = 0xffffffff7fffe351
%o7 = 0x000000010006daf4 cli_full_connection+0x58 %i7 =
0x000000010002fe64 connect_to_service+0xd4

 %ccr = 0x44 xcc=nZvc icc=nZvc
   %y = 0x0000000000000000
  %pc = 0xffffffff7e03d28c libc.so.1`strlen+0x7c
 %npc = 0xffffffff7e03d290 libc.so.1`strlen+0x80
  %sp = 0xffffffff7fffe271
  %fp = 0xffffffff7fffe351

 %asi = 0x82
%fprs = 0x04

>From browsing the list archive it doesn't appear to be a known problem
on this platform, but I found a recent thread dealing with similar
problems on 64bit Linux systems, but both might not be related.

Any help on this issue would be appretiated.

Compiling Samba for 32 bit is not a good option because of the "max
open file"-limit.

Regards
Christian Walther