[clug] Two (perhaps simple) shell questions.
Andrew Janke
a.janke at gmail.com
Tue Aug 18 06:59:04 MDT 2009
> I think a python script would be better (see the multiprocessing stuff), but if
> you want to do this with posix / shell commands, perhaps what you really want
> is to set atd to run at a load of 7.5 or similar, and then submit the whole
> lot with batch.
I have my mind more set on number of processes than load if only
because load is such a difficult thing to track. Over how long do you
average, does it count is a job is waiting on I/O, etc etc.
>> My only thought was to use make -j8 or the likes...
> If you want something more than batch, perhaps Generic NQS would be worth
> installing.
Ah, well for real stuff I use sun grid engine. Those on Debian/Ubuntu
have had their SGE install made a whole lot easier in the last year or
so. All you need to do is this:
# install the software (for a single host)
$ sudo apt-get install gridengine-master gridengine-client gridengine-exec
# add yourself as a manager
$ sudo qconf -am <username>
# add a queue
$ qconf -aq all.q
(edit things if you want -- I usually change the shell to sh instead of csh)
# add your own machine as a submit host (so that you can submit jobs)
$ qconf -as <hostname>
# then submit a job
$ qsub fred.sh
# the see how it is doing
$ qstat -f
--
Andrew Janke
(a.janke at gmail.com || http://a.janke.googlepages.com/)
Canberra->Australia +61 (402) 700 883
More information about the linux
mailing list