[distcc] Distcc is not scalling linearly , Pls help
yudhistir reddy
yudhistir.reddy at gmail.com
Thu Mar 6 06:44:21 MST 2014
Hi Martin,
Thank you . It is helpful . I can see now, more no of CPUs are used during
build . But i am sad that its not reducing the build time . Am i missing
something ? Any suggestion to check with to reduce build time with distcc .
My standalone build on "client" machine with -j32 takes around 66 mins
without DISTCC .
Data from Distcc Normal Mode:
I captured data with different -j value and used your suggestion to
increase the CPUs during build .
Client machines Server machines
(distccd running) j value CPUs used during build target name Build time
(Secs) Mins Client build01 build02 client 24 build01/build02/Client:8
final-build 3750 62.5 client build01 build02 client 32 not captured exactly
final-build 3609 60.15 client build01 build02 client 64 build01/build02:
21 , Client:20 final-build 3808 63.46667 client build01 build02
client 144 build01/build02:
50 , Client:32 final-build 5106 85.1
Configuration:
Client machine ( 16 CPU , dual socket , Linux machine)
build01/build02(64 CPU , 4 socket, Linux machine)
DISTCC_HOSTS=build01/128 build02/128 client/32
Regards
Yudhistir
On Thu, Mar 6, 2014 at 4:51 AM, Martin Pool <martinpool at gmail.com> wrote:
> distcc defaults to sending only 4 jobs to each server. (Hosts have many
> more cores than they did in ~2002 when I started this.) You can change it
> by setting eg
>
> DISTCC_HOSTS='bigmachine/16 biggermachine/100'
>
> http://distcc.googlecode.com/svn/trunk/doc/web/man/distcc_1.html
>
> On Wed Mar 05 2014 at 10:26:25 PM, yudhistir reddy <
> yudhistir.reddy at gmail.com> wrote:
>
>> Hi ,
>>
>> I am compiling code with distcc . Below is my set up
>>
>> Client machine : Linux (ubuntu) , 16 core dual socket ( logical 32 core )
>> Time takes to build code on this machine : 1 hour with -j32 .
>>
>> with Distcc :
>> Client machine is same as above one
>>
>> 2 servers with distccd daemon running ( 64 cores each )
>>
>> Same target takes almost same time or just 5 mins less . I am running
>> the make with -j32 on client to distribute the jobs .
>>
>> I am using DISTCC normal mode , writting distcclog file to local
>> directory only .
>> I set DISTCC_DIR to local directory . i can see it uses only 4 CPUs of
>> each machine . How i can scale it with distcc . why distcc is not using
>> more CPUs from other two servers as well as local host .
>>
>> Is something missing in my part ? Pls help .
>>
>>
>> Regards
>> Yudhistir
>>
>> __
>> distcc mailing list http://distcc.samba.org/
>> To unsubscribe or change options:
>> https://lists.samba.org/mailman/listinfo/distcc
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/distcc/attachments/20140306/6a0b18dd/attachment.html>
More information about the distcc
mailing list