[clug] Basic work queue

Brendan Jurd direvus at gmail.com
Sat Jun 18 01:30:26 MDT 2011


On 18 June 2011 17:19, Carlo Hamalainen <carlo.hamalainen at gmail.com> wrote:
> Hi,
>
> I have a long computation that I would like to run on Amazon EC2. I
> want to manually start up a few high-CPU instances (say 5 or 10) and
> have each instance request a task from some master instance, do the
> task, signal completion to the master, and then get the next available
> task.

Sounds like a job for
http://docs.python.org/library/multiprocessing.html#multiprocessing.Queue

Cheers,
BJ


More information about the linux mailing list