Re: Parallel::Runner and Amazon SQS Issue

Hello.

$last_seen is incremented in pararell process currently.

for my $workerid (1..$max_workers) {
  $runner->run( sub {
      #query and push queue
      $last_seen += $page_size;
  }
}

Do you mean like this?

for my $workerid (1..$max_workers) {
  $runner->run( sub {
      #query and push queue
  }
  $last_seen += $page_size;
}

Comment on Re: Parallel::Runner and Amazon SQS Issue

Replies are listed 'Best First'.
Re^2: Parallel::Runner and Amazon SQS Issue by stonecolddevin (Parson) on Sep 13, 2012 at 01:28 UTC
It would seem to me that I'd want to update in the parallel process, otherwise it only gets updated for however many children there are, not for however many items in the dataset there are. Three thousand years of beautiful tradition, from Moses to Sandy Koufax, you're god damn right I'm living in the fucking past	[reply]
Re^3: Parallel::Runner and Amazon SQS Issue by remiah (Hermit) on Sep 13, 2012 at 06:05 UTC
It seems to me, you are looking for shared variable and lock facility for ipc processes. If threads::shared is what you are looking for, please see example of zentra and example of BrowserUK and documents for thread. It is pity of me not well educated myself for threads, to say something... I hope it helps you.	[reply]
Re^4: Parallel::Runner and Amazon SQS Issue by stonecolddevin (Parson) on Sep 13, 2012 at 16:15 UTC
Thanks a bunch remiah, I think you are ultimately on the right track. I'll look into these nodes. I appreciate your help! Three thousand years of beautiful tradition, from Moses to Sandy Koufax, you're god damn right I'm living in the fucking past	[reply]