in reply to Re^2: How to vectorize a subroutine--perhapse using PDL piddles or threads
in thread How to vectorize a subroutine--perhapse using PDL piddles or threads

On the face of it that looks like it's an I/O bound process so paralleling things up on one system probably won't get you any further ahead. On the other hand, if you have access to a network of computers and you can divvy the work up between machines then maybe you can get some benefit that way.

Of course if you can avoid file I/O you may be able to get things going much faster and then threading or forking can take advantage of a multi-core system. It depends a whole bunch on what you are actually doing.

True laziness is hard work
  • Comment on Re^3: How to vectorize a subroutine--perhapse using PDL piddles or threads