[distcc] distcc over ssh - what am i doing wrong here?

Sun Feb 15 19:27:32 GMT 2004

I'm just starting to play around with distcc - it looks great, and
I wish I'd started using it when I had more machines at my disposal.  :)
I'm using distcc 2.12.1 on NetBSD/i386, in case it matters here.

Anyway, it seems to work fine with port 3632 TCP sockets, but when I
attempt to use ssh, it fails and queues the jobs locally.
I've checked all the obvious (to me) stuff - the authentication works,
I can ssh between machines without passwords, and distccd is in the
path. (I've even tried specifying the path explicitly in $DISTCC_HOSTS)

Here's the output of DISTCC_LOG with DISTCC_VERBOSE set to 1 for the
process which actually tries to execute the ssh;  I'm
not really sure what to make of it:

distcc[25205] (dcc_trace_version) distcc 2.12.1 i386--netbsdelf; built Feb 15 2004 01:53:09
distcc[25205] (dcc_recursion_safeguard) safeguard level=0
distcc[25205] (main) compiler name is "distcc"
distcc[25205] (dcc_scan_args) scanning arguments: /usr/bin/gcc -pipe -ffreestanding -pipe -Werror -Wall -Wno-main -Wno-format-zero-length -Wpointer-arith -Wmissing-prototypes -Wstrict-prototypes -Wno-sign-compare -Di386 -I. -I../../../../arch -I../../../.. -nostdinc -DLKM -DIPSEC_DEBUG -DMAXUSERS=32 -D_KERNEL -D_KERNEL_OPT -c ../../../../compat/freebsd/freebsd_ipc.c
distcc[25205] (dcc_scan_args) found input file "../../../../compat/freebsd/freebsd_ipc.c"
distcc[25205] (dcc_scan_args) no visible output file, going to add "-o freebsd_ipc.o" at end
distcc[25205] compile from freebsd_ipc.c to freebsd_ipc.o
distcc[25205] (dcc_get_hostlist) read hosts from environment
distcc[25205] (dcc_parse_hosts) found ssh token "riz at madmax"
distcc[25205] (dcc_lock_host) got cpu lock on riz at madmax slot 0 as fd4
distcc[25205] (dcc_strip_dasho) result: /usr/bin/gcc -pipe -ffreestanding -pipe -Werror -Wall -Wno-main -Wno-format-zero-length -Wpointer-arith -Wmissing-prototypes -Wstrict-prototypes -Wno-sign-compare -Di386 -I. -I../../../../arch -I../../../.. -nostdinc -DLKM -DIPSEC_DEBUG -DMAXUSERS=32 -D_KERNEL -D_KERNEL_OPT -c ../../../../compat/freebsd/freebsd_ipc.c
distcc[25205] (dcc_spawn_child) forking to execute: /usr/bin/gcc -pipe -ffreestanding -pipe -Werror -Wall -Wno-main -Wno-format-zero-length -Wpointer-arith -Wmissing-prototypes -Wstrict-prototypes -Wno-sign-compare -Di386 -I. -I../../../../arch -I../../../.. -nostdinc -DLKM -DIPSEC_DEBUG -DMAXUSERS=32 -D_KERNEL -D_KERNEL_OPT -E ../../../../compat/freebsd/freebsd_ipc.c
distcc[25205] (dcc_spawn_child) child started as pid3471
distcc[25205] (dcc_strip_local_args) result: /usr/bin/gcc -pipe -ffreestanding -pipe -Werror -Wall -Wno-main -Wno-format-zero-length -Wpointer-arith -Wmissing-prototypes -Wstrict-prototypes -Wno-sign-compare -c ../../../../compat/freebsd/freebsd_ipc.c -o freebsd_ipc.o
distcc[3471] (dcc_increment_safeguard) setting safeguard: _DISTCC_SAFEGUARD=1
distcc[25205] exec on riz at madmax: /usr/bin/gcc -pipe -ffreestanding -pipe -Werror -Wall -Wno-main -Wno-format-zero-length -Wpointer-arith -Wmissing-prototypes -Wstrict-prototypes -Wno-sign-compare -c ../../../../compat/freebsd/freebsd_ipc.c -o freebsd_ipc.o
distcc[25205] (dcc_note_state) note state 2, file "freebsd_ipc.c", host "madmax"
distcc[25205] (dcc_run_piped_cmd) execute: ssh -l riz madmax distccd --inetd
distcc[25205] (dcc_x_token_int) send DIST00000001
distcc[25205] (dcc_x_token_int) send ARGC00000010
distcc[25205] (dcc_x_token_int) send ARGV0000000c
distcc[25205] (dcc_x_token_int) send ARGV00000005
distcc[25205] (dcc_x_token_int) send ARGV0000000e
distcc[25205] (dcc_x_token_int) send ARGV00000005
distcc[25205] (dcc_x_token_int) send ARGV00000007
distcc[25205] (dcc_x_token_int) send ARGV00000005
distcc[25205] (dcc_x_token_int) send ARGV00000009
distcc[25205] (dcc_x_token_int) send ARGV00000017
distcc[25205] (dcc_x_token_int) send ARGV0000000f
distcc[25205] (dcc_x_token_int) send ARGV00000014
distcc[25205] (dcc_x_token_int) send ARGV00000013
distcc[25205] (dcc_x_token_int) send ARGV00000011
distcc[25205] (dcc_x_token_int) send ARGV00000002
distcc[25205] (dcc_x_token_int) send ARGV00000028
distcc[25205] (dcc_x_token_int) send ARGV00000002
distcc[25205] (dcc_x_token_int) send ARGV0000000d
distcc[25205] (dcc_note_state) note state 3, file "(NULL)", host "(NULL)"
distcc[25205] (dcc_collect_child) cpp child 3471 terminated with status 0
distcc[25205] (dcc_collect_child) cpp times: user 0.076848s, system 0.035507s, 479 minflt, 0 majflt
distcc[25205] cpp on localhost completed ok
distcc[25205] (dcc_note_state) note state 4, file "(NULL)", host "(NULL)"
distcc[25205] (dcc_x_file) send 279502 byte file /tmp/distcc_85b4bfae.i with token DOTI
distcc[25205] (dcc_x_token_int) send DOTI000443ce
distcc[25205] (dcc_select_for_write) select for write on fd6
distcc[25205] (dcc_select_for_write) select for write on fd6
distcc[25205] (dcc_select_for_write) select for write on fd6
distcc[25205] (dcc_select_for_write) select for write on fd6
distcc[25205] (dcc_select_for_write) select for write on fd6
distcc[25205] (dcc_pump_readwrite) ERROR: failed to write: Broken pipe
distcc[25205] (dcc_send_job) client finished sending request to server
distcc[25205] (dcc_note_state) note state 5, file "(NULL)", host "madmax"
distcc[25205] (dcc_readx) ERROR: unexpected eof on fd7
distcc[25205] (dcc_r_token_int) ERROR: read failed while waiting for token "DONE"
distcc[25205] (dcc_collect_child) ssh child 2378 terminated with status 0x6400
distcc[25205] (dcc_collect_child) ssh times: user 0.110708s, system 0.033086s, 686 minflt, 0 majflt
distcc[25205] (dcc_mark_timefile) mark /home/riz/.distcc/lock/backoff_ssh_madmax_0
distcc[25205] (dcc_build_somewhere) Warning: failed to distribute to riz at madmax, running locally instead
distcc[25205] (dcc_lock_host) got cpu lock on localhost slot 0 as fd5
distcc[25205] exec on localhost: /usr/bin/gcc -pipe -ffreestanding -pipe -Werror -Wall -Wno-main -Wno-format-zero-length -Wpointer-arith -Wmissing-prototypes -Wstrict-prototypes -Wno-sign-compare -Di386 -I. -I../../../../arch -I../../../.. -nostdinc -DLKM -DIPSEC_DEBUG -DMAXUSERS=32 -D_KERNEL -D_KERNEL_OPT -c ../../../../compat/freebsd/freebsd_ipc.c -o freebsd_ipc.o
distcc[25205] (dcc_note_state) note state 5, file "freebsd_ipc.c", host "localhost"
distcc[25205] (dcc_spawn_child) forking to execute: /usr/bin/gcc -pipe -ffreestanding -pipe -Werror -Wall -Wno-main -Wno-format-zero-length -Wpointer-arith -Wmissing-prototypes -Wstrict-prototypes -Wno-sign-compare -Di386 -I. -I../../../../arch -I../../../.. -nostdinc -DLKM -DIPSEC_DEBUG -DMAXUSERS=32 -D_KERNEL -D_KERNEL_OPT -c ../../../../compat/freebsd/freebsd_ipc.c -o freebsd_ipc.o
distcc[25205] (dcc_spawn_child) child started as pid28713
distcc[28713] (dcc_increment_safeguard) setting safeguard: _DISTCC_SAFEGUARD=1
distcc[25205] (dcc_collect_child) cc child 28713 terminated with status 0
distcc[25205] (dcc_collect_child) cc times: user 0.361958s, system 0.054665s, 2118 minflt, 0 majflt
distcc[25205] compile on localhost completed ok
distcc[25205] elapsed compilation time 2.376508s
distcc[25205] (dcc_exit) exit: code 0; self: 0.000000 user 0.024971 sys; children: 0.549514 user 0.123258 sys
distcc[25205] (dcc_cleanup_tempfiles) deleted 1 temporary files

Is there anything I can run on the far end to figure out what's going wrong?

Thanks,
+j

-- 
Jeff Rizzo                                         http://boogers.sf.ca.us/~riz