[clug] aggregating disks across multiple machines

[Daniel Pittman]

Andrew Janke <a.janke at gmail.com> writes:

>> 1. Staff should keep only working copies locally, the master should be
>>   elsewhere, ideally in a VCS style "edit, then commit" arrangement.
>
> Except in the case where the data is enormous. In what we do for
> example I can generate 1TB in 24 hours without any sweat.

I should perhaps have said "mutate, then save" or something, since I imagine
that you either produce smaller results after processing that data, or you
have an entirely different scale of problem to the OP. :)

        Daniel

-- 
✣ Daniel Pittman            ✉ daniel at rimspace.net            ☎ +61 401 155 707
               ♽ made with 100 percent post-consumer electrons
   Looking for work?  Love Perl?  In Melbourne, Australia?  We are hiring.