<div dir="ltr"><div><div><div>Hi Martin,<br><br></div>I am only one using these servers . Mostly processes under root are running . Servers are not busy . <br><br></div>I am now analyzing distcclog , I see many error messages like below ones but final build is successful and generates the binary<br>
<br>distcc[15021] ERROR: compile (null) on localhost failed<br>distcc[15043] ERROR: compile (null) on localhost failed<br>distcc[15065] ERROR: compile (null) on localhost failed<br>distcc[28077] ERROR: compile (null) on localhost failed<br>
distcc[28688] ERROR: compile (null) on localhost failed<br>distcc[28696] ERROR: compile (null) on localhost failed<br><br><br></div><div>Regards<br></div><div>Yudhistir<br></div><div><br></div><br></div><div class="gmail_extra">
<br><br><div class="gmail_quote">On Fri, Mar 7, 2014 at 3:44 AM, Martin Pool <span dir="ltr"><<a href="mailto:martinpool@gmail.com" target="_blank">martinpool@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
You're going to need to look at what processes are running during the build. Are the servers busy? Maybe there are lots of non cc jobs?<div class="HOEnZb"><div class="h5"><br><p dir="ltr"></p>
<p dir="ltr">On Friday, March 7, 2014 12:44:21 AM, yudhistir reddy <<a href="mailto:yudhistir.reddy@gmail.com" target="_blank">yudhistir.reddy@gmail.com</a>> wrote:</p>
<blockquote><p dir="ltr">Hi Martin,</p>
<p dir="ltr">Thank you . It is helpful . I can see now, more no of CPUs are used during build . But i am sad that its not reducing the build time . Am i missing something ? Any suggestion to check with to reduce build time with distcc . <br>
</p>
<p dir="ltr">My standalone build on "client" machine with -j32 takes around 66 mins without DISTCC . </p>
<p dir="ltr">Data from Distcc Normal Mode:</p>
<p dir="ltr">I captured data with different -j value and used your suggestion to increase the CPUs during build .</p>
<p dir="ltr">Client machinesServer machines <br>
(distccd running)j valueCPUs used during buildtarget nameBuild time (Secs)MinsClientbuild01 build02 client24build01/build02/Client:8final-build375062.5clientbuild01 build02 client32not captured exactlyfinal-build360960.15clientbuild01 build02 client64build01/build02: 21 , Client:20final-build380863.46667clientbuild01 build02 client144build01/build02: 50 , Client:32final-build510685.1<br>
<br><br><br><br><br><br><br><br><br><br><br></p>
<p dir="ltr">Configuration:<br><br><br><br></p>
<p dir="ltr">Client machine ( 16 CPU , dual socket , Linux machine)<br><br></p>
<p dir="ltr">build01/build02(64 CPU , 4 socket, Linux machine)<br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br></p>
<p dir="ltr">DISTCC_HOSTS=build01/128 build02/128 client/32<br><br><br><br><br><br><br><br><br></p>
<p dir="ltr">Regards<br></p>
<p dir="ltr">Yudhistir<br><br></p>
<p dir="ltr">On Thu, Mar 6, 2014 at 4:51 AM, Martin Pool <<a href="mailto:martinpool@gmail.com" target="_blank">martinpool@</a><a href="mailto:martinpool@gmail.com" target="_blank">gmail.com</a>> wrote:</p>
</blockquote>
<blockquote><blockquote><p dir="ltr">distcc defaults to sending only 4 jobs to each server. (Hosts have many more cores than they did in ~2002 when I started this.) You can change it by setting eg<br></p>
<p dir="ltr">DISTCC_HOSTS='bigmachine/16 biggermachine/100'<br></p>
<p dir="ltr"><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html" target="_blank">http://</a><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html" target="_blank">distcc.googlecode.com</a><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html" target="_blank">/</a><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html" target="_blank">svn</a><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html" target="_blank">/trunk/doc/web/man/</a><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html" target="_blank">distcc_1</a><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html" target="_blank">.</a><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html" target="_blank">html</a><br>
</p>
<p dir="ltr">On Wed Mar 05 2014 at 10:26:25 PM, yudhistir reddy <<a href="mailto:yudhistir.reddy@gmail.com" target="_blank">yudhistir.reddy</a><a href="mailto:yudhistir.reddy@gmail.com" target="_blank">@</a><a href="mailto:yudhistir.reddy@gmail.com" target="_blank">gmail.com</a>> wrote:</p>
</blockquote>
</blockquote>
<blockquote><blockquote><blockquote><p dir="ltr">Hi ,</p>
<p dir="ltr">I am compiling code with distcc . Below is my set up</p>
<p dir="ltr">Client machine : Linux (ubuntu) , 16 core dual socket ( logical 32 core )</p>
<p dir="ltr">Time takes to build code on this machine : 1 hour with -j32 .</p>
<p dir="ltr">with Distcc :</p>
<p dir="ltr">Client machine is same as above one</p>
<p dir="ltr">2 servers with distccd daemon running ( 64 cores each )</p>
<p dir="ltr">Same target takes almost same time or just 5 mins less . I am running the make with -j32 on client to distribute the jobs .</p>
<p dir="ltr">I am using DISTCC normal mode , writting distcclog file to local directory only . </p>
<p dir="ltr">I set DISTCC_DIR to local directory . i can see it uses only 4 CPUs of each machine . How i can scale it with distcc . why distcc is not using more CPUs from other two servers as well as local host .</p>
<p dir="ltr">Is something missing in my part ? Pls help .<br></p>
<p dir="ltr">Regards</p>
<p dir="ltr">Yudhistir<br></p>
<p dir="ltr">__<br>
distcc mailing list <a href="http://distcc.samba.org/" target="_blank">http://</a><a href="http://distcc.samba.org/" target="_blank">distcc.samba.org</a><a href="http://distcc.samba.org/" target="_blank">/</a><br>
To unsubscribe or change options:<br>
<a href="https://lists.samba.org/mailman/listinfo/distcc" target="_blank">https</a><a href="https://lists.samba.org/mailman/listinfo/distcc" target="_blank">://</a><a href="https://lists.samba.org/mailman/listinfo/distcc" target="_blank">lists.samba.org</a><a href="https://lists.samba.org/mailman/listinfo/distcc" target="_blank">/mailman/</a><a href="https://lists.samba.org/mailman/listinfo/distcc" target="_blank">listinfo</a><a href="https://lists.samba.org/mailman/listinfo/distcc" target="_blank">/</a><a href="https://lists.samba.org/mailman/listinfo/distcc" target="_blank">distcc</a><br>
</p>
</blockquote>
</blockquote>
</blockquote>
<blockquote><p dir="ltr"><br>
</p>
</blockquote>
<p dir="ltr"><br>
</p>
</div></div></blockquote></div><br></div>