[distcc] distcc over SSH

Thu Oct 2 14:02:22 GMT 2003

Hi, I'm having problems using distcc over SSH. distcc as a
daemon works fine, but this is less than optimal because of
security issues. However, running distcc over SSH seems to give
all sorts of PATH problems. distcc lives in /arch/beta/bin (the
convention for this enviornment). When calling make as 'make
CC="/arch/beta/bin/distcc /usr/bin/gcc"
CXX="/arch/beta/bin/distcc /usr/bin/g++"', it fails because it
either can't find ssh or as. Attached is the debugged output from make/distcc.
-------------- next part --------------
make[1]: Entering directory `/net/arch-linux/unix/src/wine-20030911/libs'
make[2]: Entering directory `/net/arch-linux/unix/src/wine-20030911/libs/port'
/arch/beta/bin/distcc /usr/bin/gcc -c -I. -I. -I../../include -I../../include  -D_REENTRANT -fPIC -D__WINESRC__ -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith  -g -O2 -o getopt.o getopt.c
distcc[15816] (dcc_trace_version) distcc 2.11 i686-pc-linux-gnu; built Oct  2 2003 09:30:44
distcc[15816] (dcc_recursion_safeguard) safeguard level=0
distcc[15816] (dcc_trim_path) original PATH /proj/crew/ari/BitTorrent-3.2.1b:~/bin:/proj/crew/ari/mplayer/bin:~/bin/linux:/proj/crew/ari/bin/linux:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/games:/ccs/bin:/arch/beta/bin:/arch/beta/bin
distcc[15816] (dcc_set_path) setting PATH=
distcc[15816] (dcc_scan_args) scanning arguments: /usr/bin/gcc -c -I. -I. -I../../include -I../../include -D_REENTRANT -fPIC -D__WINESRC__ -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 -o getopt.o getopt.c
distcc[15816] (dcc_scan_args) found object/output file "getopt.o"
distcc[15816] (dcc_scan_args) found input file "getopt.c"
distcc[15816] compile from getopt.c to getopt.o
distcc[15816] (dcc_get_hostlist) read hosts from environment
distcc[15816] (dcc_parse_hosts) found ssh token "@hobgoblin"
distcc[15816] (dcc_parse_hosts) found ssh token "@joker"
distcc[15816] (dcc_parse_hosts) found ssh token "@kingpin"
distcc[15816] (dcc_parse_hosts) found ssh token "@lex-luthor"
distcc[15816] (dcc_parse_hosts) found ssh token "@magneto"
distcc[15816] (dcc_parse_hosts) found ssh token "@mr-freeze"
distcc[15816] (dcc_parse_hosts) found ssh token "@mystique"
distcc[15816] (dcc_parse_hosts) found ssh token "@penguin"
distcc[15816] (dcc_parse_hosts) found ssh token "@riddler"
distcc[15816] (dcc_parse_hosts) found ssh token "@two-face"
distcc[15816] (dcc_parse_hosts) found ssh token "@venom"
distcc[15816] (dcc_lock_host) got cpu lock on @hobgoblin slot 0 as fd3
distcc[15816] (dcc_strip_dasho) result: /usr/bin/gcc -c -I. -I. -I../../include -I../../include -D_REENTRANT -fPIC -D__WINESRC__ -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 getopt.c
distcc[15816] (dcc_spawn_child) forking to execute: /usr/bin/gcc -E -I. -I. -I../../include -I../../include -D_REENTRANT -fPIC -D__WINESRC__ -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 getopt.c
distcc[15816] (dcc_spawn_child) child started as pid15817
distcc[15816] (dcc_strip_local_args) result: /usr/bin/gcc -c -fPIC -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 -o getopt.o getopt.c
distcc[15816] exec on @hobgoblin: /usr/bin/gcc -c -fPIC -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 -o getopt.o getopt.c
distcc[15817] (dcc_increment_safeguard) setting safeguard: _DISTCC_SAFEGUARD=1
distcc[15816] (dcc_note_state) note state 2, file "getopt.c", host "hobgoblin"
distcc[15816] (dcc_run_piped_cmd) execute: ssh hobgoblin distccd --inetd
distcc[15816] (tcp_cork_sock) no corks allowed on fd5
distcc[15816] (dcc_x_token_int) send DIST00000001
distcc[15816] (dcc_x_token_int) send ARGC0000000d
distcc[15816] (dcc_x_token_int) send ARGV0000000c
distcc[15816] (dcc_x_token_int) send ARGV00000002
distcc[15816] (dcc_x_token_int) send ARGV00000005
distcc[15816] (dcc_x_token_int) send ARGV00000005
distcc[15816] (dcc_x_token_int) send ARGV0000001c
distcc[15816] (dcc_x_token_int) send ARGV00000014
distcc[15816] (dcc_x_token_int) send ARGV00000008
distcc[15816] (dcc_x_token_int) send ARGV0000000f
distcc[15816] (dcc_x_token_int) send ARGV00000002
distcc[15816] (dcc_x_token_int) send ARGV00000003
distcc[15816] (dcc_x_token_int) send ARGV00000002
distcc[15816] (dcc_x_token_int) send ARGV00000008
distcc[15816] (dcc_x_token_int) send ARGV00000008
distcc[15816] (dcc_note_state) note state 3, file "(NULL)", host "(NULL)"
distcc[15819] (dcc_run_piped_cmd) ERROR: failed to exec ssh: No such file or directory
distcc[15819] (dcc_mark_timefile) mark /home/ari/.distcc/lock/backoff_ssh_hobgoblin_0
distcc[15819] (dcc_build_somewhere) Warning: failed to distribute to @hobgoblin, running locally instead
distcc[15819] (dcc_lock_host) got cpu lock on localhost slot 0 as fd4
distcc[15819] exec on localhost: /usr/bin/gcc -c -I. -I. -I../../include -I../../include -D_REENTRANT -fPIC -D__WINESRC__ -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 -o getopt.o getopt.c
distcc[15819] (dcc_note_state) note state 5, file "getopt.c", host "localhost"
distcc[15819] (dcc_spawn_child) forking to execute: /usr/bin/gcc -c -I. -I. -I../../include -I../../include -D_REENTRANT -fPIC -D__WINESRC__ -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 -o getopt.o getopt.c
distcc[15819] (dcc_spawn_child) child started as pid15820
distcc[15820] (dcc_increment_safeguard) setting safeguard: _DISTCC_SAFEGUARD=1
distcc[15816] (dcc_collect_child) cpp child 15817 terminated with status 0
distcc[15816] (dcc_collect_child) cpp times: user 0.030000s, system 0.010000s, 198 minflt, 412 majflt
distcc[15816] cpp on localhost completed ok
distcc[15816] (dcc_note_state) note state 4, file "(NULL)", host "(NULL)"
distcc[15816] (dcc_x_file) send 19377 byte file /tmp/distcc_28712fe8.i with token DOTI
distcc[15816] (dcc_x_token_int) send DOTI00004bb1
distcc[15816] (dcc_send_job) client finished sending request to server
distcc[15816] (dcc_note_state) note state 5, file "(NULL)", host "hobgoblin"
distcc[15816] (dcc_select_for_read) select for read on fd6 for 300s
gcc: installation problem, cannot exec `as': No such file or directory
distcc[15819] (dcc_collect_child) cc child 15820 terminated with status 0x100
distcc[15819] (dcc_collect_child) cc times: user 0.040000s, system 0.010000s, 395 minflt, 631 majflt
distcc[15819] ERROR: compile on localhost failed
distcc[15819] elapsed compilation time 0.132620s
distcc[15819] (dcc_exit) exit: code 1; self: 0.000000 user 0.000000 sys; children: 0.040000 user 0.010000 sys
distcc[15819] (dcc_cleanup_tempfiles) deleted 1 temporary files
distcc[15816] (dcc_readx) ERROR: unexpected eof on fd6
distcc[15816] (dcc_r_token_int) ERROR: read failed while waiting for token "DONE"
distcc[15816] (dcc_collect_child) ssh child 15819 terminated with status 0x100
distcc[15816] (dcc_collect_child) ssh times: user 0.040000s, system 0.010000s, 417 minflt, 642 majflt
distcc[15816] (dcc_mark_timefile) mark /home/ari/.distcc/lock/backoff_ssh_hobgoblin_0
distcc[15816] (dcc_build_somewhere) Warning: failed to distribute to @hobgoblin, running locally instead
distcc[15816] (dcc_lock_host) got cpu lock on localhost slot 0 as fd4
distcc[15816] exec on localhost: /usr/bin/gcc -c -I. -I. -I../../include -I../../include -D_REENTRANT -fPIC -D__WINESRC__ -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 -o getopt.o getopt.c
distcc[15816] (dcc_note_state) note state 5, file "getopt.c", host "localhost"
distcc[15816] (dcc_spawn_child) forking to execute: /usr/bin/gcc -c -I. -I. -I../../include -I../../include -D_REENTRANT -fPIC -D__WINESRC__ -Wall -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 -o getopt.o getopt.c
distcc[15816] (dcc_spawn_child) child started as pid15823
distcc[15823] (dcc_increment_safeguard) setting safeguard: _DISTCC_SAFEGUARD=1
gcc: installation problem, cannot exec `as': No such file or directory
distcc[15816] (dcc_collect_child) cc child 15823 terminated with status 0x100
distcc[15816] (dcc_collect_child) cc times: user 0.030000s, system 0.020000s, 396 minflt, 631 majflt
distcc[15816] ERROR: compile on localhost failed
distcc[15816] elapsed compilation time 0.203690s
distcc[15816] (dcc_exit) exit: code 1; self: 0.000000 user 0.010000 sys; children: 0.100000 user 0.040000 sys
distcc[15816] (dcc_cleanup_tempfiles) deleted 1 temporary files
make[2]: *** [getopt.o] Error 1
make[2]: Leaving directory `/net/arch-linux/unix/src/wine-20030911/libs/port'
make[1]: *** [port] Error 2
make[1]: Leaving directory `/net/arch-linux/unix/src/wine-20030911/libs'
make: *** [libs] Error 2