[distcc] Limiting cpp0, randomizing hosts,
more verbose localhost lockfile names
logic at jrlogic.dyndns.org
logic at jrlogic.dyndns.org
Tue Mar 29 02:37:13 GMT 2005
> Our local setup is that no compiling is done locally. We've got big
> enough jobs that the local machine is busy with linking and
> preprocessing. We also found that going above about -j 15 didn't
> improve total time to compile by much, even on a 4 processor box.
>
>
>
> Limiting the preprocessor helps achieve a healthy level of parallelism.
> Currently, we have to carefully adjust the parallel factor in make, so
> that it doesn't overwhelm the local machine. By using lock files to
> control that instead, we can now dramatically increase the j factor, and
> it doesn't slow down the build.
> Michael
Try using:
$ make -j -l8
on a 4 processor box. This instructs job control to restrict the load to 8
(loosely approximated to 8 jobs wanting to be in a running state
simultaneously). If all of the compilation is done remotely, several
preprocessor tasks can run, hopefully with most blocking on network I/O
allowing full use of system CPU resources with active preprocessing.
More information about the distcc
mailing list