[distcc] Loadbalanced distcc

[Martin Pool]

On Thu, 2006-01-05 at 18:50 -0500, Sean D'Epagnier wrote:
> On 1/5/06, Victor Norman <vtnpgh at yahoo.com> wrote:
>         Sean, et al., 
>         
>         You do seem to understand my system correctly: dmucs is a
>         wrapper around distcc which is a wrapper around gcc.
>         
>         Note that we here at marconi use pcons, not make to build our
>         tree.  pcons is smarter than make because it calculates the
>         entire tree of build dependencies before beginning to compile
>         even the first file.  So, it can know which things to do in
>         which order.  Now, in my opinion, pcons isn't quite smart
>         enough, because it doesn't parallelize compiles across
>         multiple directories -- that would REALLY speed up the
>         compile, I think.

SCons can parallelize across directories in a very nice way, by building
a dependency graph for the whole project first.  It gets quite good use
out of distcc, thought perhaps it could be better by understanding that
compilation can be parallelized more than other tasks.

You might be able to build something good on top of gnu make's debug
option to dump out the dependency tree, but I think most Makefiles won't
have detailed correct dependencies between directories.


-- 
Martin

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url : http://lists.samba.org/archive/distcc/attachments/20060106/fce35403/attachment.bin