[Samba] nsswitch segfaults with Samba 3.0.21 on Solaris 9

[J S]

Adding the patched code into winbind_nss_solaris.c and it now compiles  with
--enable-developer flags, but the same segfault on su once I add
libnss_wins.so and libnss_winbind.so into /usr/lib. Here's the failure
section of the truss output:


open("/etc/hosts", O_RDONLY|O_LARGEFILE)        = 8
fcntl(8, F_DUPFD, 0x00000100)                   = 256
close(8)                                        = 0
read(256, " #\n #   I n t e r n e t".., 1024)   = 176
read(256, 0x00035FE8, 1024)                     = 0
close(256)                                      = 0
brk(0x000AFE70)                                 = 0
brk(0x000BDE70)                                 = 0
brk(0x000BDE70)                                 = 0
brk(0x000CDE70)                                 = 0
stat("/etc/resolv.conf", 0xFFBFB020)            = 0
sysconfig(_CONFIG_OPEN_FILES)                   = 2000
so_socket(PF_INET, SOCK_DGRAM, IPPROTO_IP, "", 1) = 8
connect(8, 0x00036A08, 16, 1)                   = 0
send(8, "94DD01\0\001\0\0\0\0\0\0".., 40, 0)    = 40
poll(0xFFBFAB08, 1, 5000)                       = 1
recvfrom(8, "94DD8580\001\001\002\002".., 65536, 0, 0xFFBFAA00, 0xFFBFAB04)
= 141
close(8)                                        = 0
stat("/etc/resolv.conf", 0xFFBF9F40)            = 0
sysconfig(_CONFIG_OPEN_FILES)                   = 2000
so_socket(PF_INET, SOCK_DGRAM, IPPROTO_IP, "", 1) = 8
connect(8, 0x00036A08, 16, 1)                   = 0
send(8, "94DE01\0\001\0\0\0\0\0\0".., 37, 0)    = 37
poll(0xFFBF9A28, 1, 5000)                       = 1
recvfrom(8, "94DE8580\001\001\002\002".., 65536, 0, 0xFFBF9920, 0xFFBF9A24)
= 121
close(8)                                        = 0
    Incurred fault #6, FLTBOUNDS  %pc = 0xFED721FC
      siginfo: SIGSEGV SEGV_MAPERR addr=0x0000000D
    Received signal #11, SIGSEGV [default]
      siginfo: SIGSEGV SEGV_MAPERR addr=0x0000000D





On 3/13/06, Jeremy Allison <jra at samba.org> wrote:
>
> On Mon, Mar 13, 2006 at 06:43:09PM -0800, J S wrote:
> > Compiling with the --enable-developer and --enable-debug options, the
> > compiler complains about calling malloc directly on solaris during
> nsswitch
> > then fails.  This is gcc 3.3.2 on Solaris 9.
> >
> > Here are the configure flags:
> >
> > ./configure CPPFLAGS="-I/export/build/ldap/include -I/usr/local/include
> > -I/usr/local/BerkeleyDB.4.2/include -I/usr/local/ssl/include
> > -I/export/build/krb5/include" LD_LIBRARY_PATH="-L/export/build/ldap/lib
> > -L/usr/local/lib -L/usr/local/BerkeleyDB.4.2/lib -L/usr/local/ssl/lib
> > -L/export/build/krb5/lib" LDFLAGS="-L/export/build/ldap/lib
> -L/usr/local/lib
> > -L/usr/local/BerkeleyDB.4.2/lib -L/usr/local/ssl/lib
> > -L/export/build/krb5/lib -R/export/build/ldap/lib -R/usr/local/lib
> > -R/usr/local/BerkeleyDB.4.2/lib -R/usr/local/ssl/lib
> > -R/export/build/krb5/lib" --prefix=/export/build/smb321 --enable-debug
> > CC=gcc --with-ads --enable-debug --with-winbind --enable-developer
> >
> > And here's the warning.
>
> I just checked in a fix for this in the SAMBA_3_0 and trunk branches.
>
> Jeremy.
>