[distcc] Distcc pump mode

yudhistir reddy yudhistir.reddy at gmail.com
Thu Mar 13 05:53:14 MDT 2014 

Sorry for that , that was silly mistake by me .

Here is the use case , i did :

1. eval `pump --startup`
checked pump mode variables , i can see INCLUDE_SERVER_PORT set to
/tmp/distcc-pump.LIlIcs/socket


2. started build
mk kernel -j30 WITH_DISTCC=yes
Build finished with pump mode  ( But actually it is turing back to Normal
mode ) .
I see the warning messages in distcclog as like below

distcc[12968] Warning: INCLUDE_SERVER_PORT not set - did you forget to run
under 'pump'?
distcc[12968] (dcc_build_somewhere) Warning: failed to get includes from
include server, preprocessing locally

3. build finished
4. checked this variable INCLUDE_SERVER_PORT which is set to
/tmp/distcc-pump.LIlIcs/socket .


So through out build , INCLUDE_SERVER_PORT variable is set to
/tmp/distcc-pump.LIlIcs/socket .


But i donot know how , pump mode is not working and throwing those errors .


Regards
Yudhistir










On Thu, Mar 13, 2014 at 4:34 PM, Fergus Henderson <fergus at google.com> wrote:

>
> On 13 Mar 2014 10:54, "yudhistir reddy" <yudhistir.reddy at gmail.com> wrote:
> >
> > Hi,
> >
> > I followed this
> >
> > 1.started pump mode like
> >
> > eval 'pump --startup'
>
> That should use back quotes:
> eval `pump --startup`
> NOT
> eval 'pump --startup'
>
> > export INCLUDE_SERVER_PID='13821'
> > export INCLUDE_SERVER_DIR='/tmp/distcc-pump.ygmgYX'
> > export INCLUDE_SERVER_PORT='/tmp/distcc-pump.ygmgYX/socket'
> >
> > 2.  didnot start mk command yet .
> > I want to see the variable value
> >
> > echo $INCLUDE_SERVER_PORT .
> >
> > It is showing nothing . So all pump mode variables are not getting
> exported properly . I think something is wrong with exporting . I am using
> bash shell .
> >
> > Any suggestions , why its not exporting variables properly .
> >
> > P.s : mk didnot start yet .
> >
> > Regards
> > Yudhistir
> >
> >
> >
> >
> >
> >
> > On Thu, Mar 13, 2014 at 3:51 PM, yudhistir reddy <
> yudhistir.reddy at gmail.com> wrote:
> >>
> >> sample output..
> >>
> >> src >pump env
> >> __________Using distcc-pump from
> /shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin
> >> __________Using 4 distcc servers in pump mode
> >> LOGNAME=
> >> _=/shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin/pump
> >> BLOCKSIZE=K
> >> INCLUDE_SERVER_PORT=/tmp/distcc-pump.iA44t8/socket
> >> OSTYPE=linux
> >> SSH_CONNECTION=<ip address> 58236 <ip address> 22
> >> DISTCC_HOSTS=s-server01/32,cpp,lzo s-server02/32,cpp,lzo
> s-server03/32,cpp,lzo s-server04/32,cpp,lzo
> >> HOSTTYPE=x86_64-linux
> >> EDITOR=vi
> >> __________Shutting down distcc-pump include server
> >>
> >> It is diplaying the INCLUDE_SERVER_PORT and its creating the file there
> in /tmp directory .
> >>
> >> otherway:
> >> eval 'pump --startup'
> >> export INCLUDE_SERVER_PID='13821'
> >> export INCLUDE_SERVER_DIR='/tmp/distcc-pump.ygmgYX'
> >> export INCLUDE_SERVER_PORT='/tmp/distcc-pump.ygmgYX/socket'
> >>
> >>
> >>
> >>
> >> On Thu, Mar 13, 2014 at 2:48 PM, Vanush <misha at cs.nuim.ie> wrote:
> >>>
> >>> On Thu, Mar 13, 2014 at 12:10:24PM +0530, yudhistir reddy wrote:
> >>> > Thank you. Is there any way i can display the list of environment
> variables
> >>> > it sets once pump script starts . mk is just the wrapper to call
> make . We
> >>> > are not doing anything in that . But still i will dig into it more
> (mk) .
> >>> > distcc normal mode is working fine and i see 10% build time
> reduction.
> >>>
> >>> I would suspect that whichever way mk is started by the shell it
> >>> resets the environment. Can you show this "mk" script (or at least its
> >>> first few lines)?
> >>>
> >>> Withouth looking at pump itself: is it possible to do someting like
> >>> "pump env" (this should show the environment), and then add an env
> >>> invocation into "mk" script, just before calling make, and compare
> >>> outputs?
> >>>
> >>> Misha.
> >>>
> >>> > Is there any work around for this . I can export these variable for
> some
> >>> > fixed port like 3632 for tcp .  Pls let me know any other variables
> i need
> >>> > to set to make this pump mode work . Actually i am running out of
> time
> >>> > because i need to show my colleagues and friends , how distcc is
> working
> >>> > and improving build time . For the time being , i need some work
> around for
> >>> > pump mode to work , then later i will debug more on this .
> >>> >
> >>> > Any help on this much appreciated .
> >>> >
> >>> > Regards
> >>> > Yudhistir
> >>> > Any help on this much appreciated .
> >>> >
> >>> > Regards
> >>> > Yudhistir
> >>> >
> >>> >
> >>> > On Thu, Mar 13, 2014 at 3:04 AM, Fergus Henderson <fergus at google.com>
> wrote:
> >>> >
> >>> > > The pump script will set that environment variable before invoking
> "mk".
> >>> > > But perhaps "mk" is resetting the environment? Or something else
> between
> >>> > > "mk" and "distcc" might be unsetting it?
> >>> > > On 11 Mar 2014 14:13, "yudhistir reddy" <yudhistir.reddy at gmail.com>
> wrote:
> >>> > >
> >>> > >> Hi,
> >>> > >>
> >>> > >> I am trying to build using distcc pump mode .
> >>> > >>
> >>> > >> I set DISTCC_HOSTS .
> >>> > >>
> >>> > >> i am starting the pump mode with
> >>> > >>
> >>> > >> pump mk jkernel-jobs WITH_DISTCC=yes
> >>> > >>
> >>> > >> I am getting below waring
> >>> > >>
> >>> > >> distcc[3342] Warning: INCLUDE_SERVER_PORT not set - did you
> forget to run
> >>> > >> under 'pump'?
> >>> > >> distcc[3342] (dcc_build_somewhere) Warning: failed to get
> includes from
> >>> > >> include server, preprocessing locally
> >>> > >>
> >>> > >>
> >>> > >> When we start pump mode , is distcc not setting this variable ?
> >>> > >>
> >>> > >>
> >>> > >>
> >>> > >> Regards
> >>> > >> Yudhistir
> >>> > >>
> >>> > >>
> >>> > >>
> >>> > >>
> >>> > >> __
> >>> > >> distcc mailing list            http://distcc.samba.org/
> >>> > >> To unsubscribe or change options:
> >>> > >> https://lists.samba.org/mailman/listinfo/distcc
> >>> > >>
> >>> > >
> >>>
> >>> > __
> >>> > distcc mailing list            http://distcc.samba.org/
> >>> > To unsubscribe or change options:
> >>> > https://lists.samba.org/mailman/listinfo/distcc
> >>>
> >>>
> >>> --
> >>> Vanush "Misha" Paturyan
> >>> Senior Technical Officer
> >>> Room 1.37
> >>> Computer Science Department
> >>> NUI Maynooth
> >>> __
> >>> distcc mailing list            http://distcc.samba.org/
> >>> To unsubscribe or change options:
> >>> https://lists.samba.org/mailman/listinfo/distcc
> >>
> >>
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/distcc/attachments/20140313/00417dcb/attachment.html>

More information about the distcc mailing list