<div dir="ltr"><div><div><div>Hi Martin,<br><br></div>Thank you . It is helpful . I can see now, more no of CPUs are used during build . But i am sad that its not reducing the build time . Am i missing something ? Any suggestion to check with to reduce build time with distcc . <br>
<br></div>My standalone build on "client" machine with -j32 takes around 66 mins without DISTCC . <br><br></div><div>Data from Distcc Normal Mode:<br><br></div>I captured data with different -j value and used your suggestion to increase the CPUs during build .<br>
<br>
<table border="0" cellpadding="0" cellspacing="0" width="933"><colgroup><col style="width:101pt" width="135">
<col style="width:166pt" width="221">
<col style="width:48pt" width="64">
<col style="width:147pt" width="196">
<col style="width:106pt" width="141">
<col style="width:84pt" width="112">
<col style="width:48pt" width="64">
</colgroup><tbody><tr style="height:15pt" height="20">
<td style="height:15pt;width:101pt" height="20" width="135">
<table border="0" cellpadding="0" cellspacing="0" width="933"><colgroup><col style="width:101pt" width="135">
<col style="width:166pt" width="221">
<col style="width:48pt" width="64">
<col style="width:147pt" width="196">
<col style="width:106pt" width="141">
<col style="width:84pt" width="112">
<col style="width:48pt" width="64">
</colgroup><tbody><tr style="height:15pt" height="20">
<td style="height:15pt;width:101pt" height="20" width="135">
<table border="0" cellpadding="0" cellspacing="0" width="795"><colgroup><col style="width:101pt" width="135">
<col style="width:107pt" width="142">
<col style="width:48pt" width="64">
<col style="width:147pt" width="196">
<col style="width:62pt" width="82">
<col style="width:84pt" width="112">
<col style="width:48pt" width="64">
</colgroup><tbody><tr style="height:30pt" height="40">
<td style="height:30pt;width:101pt" height="40" width="135">Client machines</td>
<td class="" style="width:107pt" width="142">Server machines <br>
(distccd running)</td>
<td style="width:48pt" width="64">j value</td>
<td style="width:147pt" width="196">CPUs used during build</td>
<td style="width:62pt" width="82">target name</td>
<td style="width:84pt" width="112">Build time (Secs)</td>
<td style="width:48pt" width="64">Mins</td>
</tr>
<tr style="height:15pt" height="20">
<td style="height:15pt" height="20">Client</td>
<td>build01 build02 client</td>
<td class="">24</td>
<td>build01/build02/Client:8</td>
<td>final-build</td>
<td class="">3750</td>
<td class="">62.5</td>
</tr>
<tr style="height:15pt" height="20">
<td style="height:15pt" height="20">client</td>
<td class="" style="width:107pt" width="142">build01 build02 client</td>
<td class="">32</td>
<td>not captured exactly</td>
<td>final-build</td>
<td class="">3609</td>
<td class="">60.15</td>
</tr>
<tr style="height:15pt" height="20">
<td style="height:15pt" height="20">client</td>
<td class="" style="width:107pt" width="142">build01 build02 client</td>
<td class="">64</td>
<td>build01/build02: 21 , Client:20</td>
<td>final-build</td>
<td class="">3808</td>
<td class="">63.46667</td>
</tr>
<tr style="height:15pt" height="20">
<td style="height:15pt" height="20">client</td>
<td class="" style="width:107pt" width="142">build01 build02 client</td>
<td class="">144</td>
<td>build01/build02: 50 , Client:32</td>
<td>final-build</td>
<td class="">5106</td>
<td class="">85.1</td>
</tr>
<tr style="height:15pt" height="20">
<td style="height:15pt" height="20"><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
</tr>
<tr style="height:15pt" height="20">
<td style="height:15pt" height="20"><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
</tr>
<tr style="height:15pt" height="20">
<td style="height:15pt" height="20">Configuration:</td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
</tr>
<tr style="height:15pt" height="20">
<td colspan="3" style="height:15pt" height="20">Client
machine ( 16 CPU , dual socket , Linux machine)</td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
</tr>
<tr style="height:15pt" height="20">
<td colspan="3" style="height:15pt" height="20">build01/build02(64
CPU , 4 socket, Linux machine)</td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
</tr>
<tr style="height:15pt" height="20">
<td style="height:15pt" height="20"><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
</tr>
<tr style="height:15pt" height="20">
<td style="height:15pt" height="20"><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
</tr>
<tr style="height:15pt" height="20">
<td colspan="3" style="height:15pt" height="20">DISTCC_HOSTS=build01/128
build02/128 client/32</td>
<td><br></td>
<td><br></td>
<td><br></td>
<td><br></td>
</tr>
</tbody></table></td><td style="width:166pt" width="221"><br></td><td style="width:48pt" width="64"><br></td><td style="width:147pt" width="196"><br></td><td style="width:106pt" width="141"><br></td><td style="width:84pt" width="112">
<br></td><td style="width:48pt" width="64"><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br>Regards<br>Yudhistir</td><td></td><td class=""><br></td><td><br></td><td><br></td><td class="">
<br></td><td class=""><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td class="" style="width:166pt" width="221"><br></td><td class=""><br></td><td><br></td><td><br></td><td class="">
<br></td><td class=""><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td class="" style="width:166pt" width="221"><br></td><td class=""><br></td><td><br></td><td><br></td><td class="">
<br></td><td class=""><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td class="" style="width:166pt" width="221"><br></td><td class=""><br></td><td><br></td><td><br></td><td class="">
<br></td><td class=""><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20">
<td style="height:15pt" height="20"></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td><br></td><td>
<br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td colspan="2" style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td>
</tr><tr style="height:15pt" height="20"><td colspan="2" style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20">
<br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td>
<td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td colspan="2" style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr></tbody></table></td><td style="width:166pt" width="221">
<br></td><td style="width:48pt" width="64"><br></td><td style="width:147pt" width="196"><br></td><td style="width:106pt" width="141"><br></td><td style="width:84pt" width="112"><br></td><td style="width:48pt" width="64"><br>
</td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td><br></td><td align="right"><br></td><td><br></td><td><br></td><td align="right"><br></td><td align="right"><br></td></tr><tr style="height:15pt" height="20">
<td style="height:15pt" height="20"><br></td><td class="" style="width:166pt" width="221"><br></td><td align="right"><br></td><td><br></td><td><br></td><td align="right"><br></td><td align="right"><br></td></tr><tr style="height:15pt" height="20">
<td style="height:15pt" height="20"><br></td><td class="" style="width:166pt" width="221"><br></td><td align="right"><br></td><td><br></td><td><br></td><td align="right"><br></td><td align="right"><br></td></tr><tr style="height:15pt" height="20">
<td style="height:15pt" height="20"><br></td><td class="" style="width:166pt" width="221"><br></td><td align="right"><br></td><td><br></td><td><br></td><td align="right"><br></td><td align="right"><br></td></tr><tr style="height:15pt" height="20">
<td style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td><br></td>
<td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br>
</td></tr><tr style="height:15pt" height="20"><td colspan="2" style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td colspan="2" style="height:15pt" height="20">
<br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td>
<td><br></td></tr><tr style="height:15pt" height="20"><td style="height:15pt" height="20"><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr><tr style="height:15pt" height="20"><td colspan="2" style="height:15pt" height="20">
<br></td><td><br></td><td><br></td><td><br></td><td><br></td><td><br></td></tr></tbody></table><br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, Mar 6, 2014 at 4:51 AM, Martin Pool <span dir="ltr"><<a href="mailto:martinpool@gmail.com" target="_blank">martinpool@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">distcc defaults to sending only 4 jobs to each server. (Hosts have many more cores than they did in ~2002 when I started this.) You can change it by setting eg<br>
<div><br></div><div>DISTCC_HOSTS='bigmachine/16 biggermachine/100'<br>
</div><div><br></div><div><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html" target="_blank">http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html</a><br></div><div><div class="h5"><br>
<div>On Wed Mar 05 2014 at 10:26:25 PM, yudhistir reddy <<a href="mailto:yudhistir.reddy@gmail.com" target="_blank">yudhistir.reddy@gmail.com</a>> wrote:</div>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5"><div dir="ltr"><div><div><div><div><div><div><div><div><div><div><div><div>Hi ,<br><br>
</div>I am compiling code with distcc . Below is my set up<br>
<br></div>Client machine : Linux (ubuntu) , 16 core dual socket ( logical 32 core )<br>
</div>Time takes to build code on this machine : 1 hour with -j32 .<br><br></div>with Distcc :<br></div>Client machine is same as above one<br><br></div>2 servers with distccd daemon running ( 64 cores each )<br><br></div>
Same target takes almost same time or just 5 mins less . I am running the make with -j32 on client to distribute the jobs .<br><br></div>I am using DISTCC normal mode , writting distcclog file to local directory only . <br>
</div>I set DISTCC_DIR to local directory . i can see it uses only 4 CPUs of each machine . How i can scale it with distcc . why distcc is not using more CPUs from other two servers as well as local host .<br><br></div>Is something missing in my part ? Pls help .<br>
<br><br></div>Regards<br></div>Yudhistir<br><div><div><div><div><div><div><div><div><div><div><br></div></div></div></div></div></div></div></div></div></div></div></div></div>
__<br>
distcc mailing list <a href="http://distcc.samba.org/" target="_blank">http://distcc.samba.org/</a><br>
To unsubscribe or change options:<br>
<a href="https://lists.samba.org/mailman/listinfo/distcc" target="_blank">https://lists.samba.org/<u></u>mailman/listinfo/distcc</a></blockquote>
</blockquote></div><br></div>