Re: Grid computing & Amazon EC2

It might help if you explained more what you are trying to accomplish. Capistrano and Net::Amazon::EC2 don't do at all the same thing.

Are you wanting to use Perl to start and stop Amazon EC2 instances? Then your options are to use Net::Amazon::EC2 or to run the EC2 API command line tools from inside a Perl program.

If you're looking for ways to configure new Linux boxes using software based on Perl, then that has very little to do specifically with EC2. Since Amazon EC2 instances are running various Linux distros and you have root access, you can use any system configuration software which runs on Linux, including Capistrano.

-- Eric Hammond

Comment on Re: Grid computing & Amazon EC2

Replies are listed 'Best First'.
Re^2: Grid computing & Amazon EC2 by Krambambuli (Curate) on Jan 14, 2009 at 07:51 UTC
I want to split the burden of processing a huge file of data over a number of instances. Basically, split the starting file in parts, give each instance a part to work upon, then collect and (re-)assemble the result data when it becomes available. The parts can be processed independently one of each other, it's basically a validation. I have something similar working fine with forks - but I'd want to check how it does when splitting the job over a number of different machines. The take-that/give me what you've done part is where I'm looking for solutions, as I'm unsure about how to communicate with the (remote) processes that do there work on the launched instances. Thanks. Krambambuli ---	[reply]
Re^3: Grid computing & Amazon EC2 by andye (Curate) on Jan 15, 2009 at 11:58 UTC
The take-that/give me what you've done part is where I'm looking for solutions, as I'm unsure about how to communicate with the (remote) processes that do there work on the launched instances. I've used Amazon's own messaging service for this with success - that's its intended use AFAIR. HTH!	[reply]