Good stuff here thanks for the reply!!

A couple of questions, and my apologies if these are simple/dumb but I have 0 experience with fork, to date most of my programs have been very simple.

1. Where in your pseudo code would I be forking a process?

2. Does the queue maintain a list of requests to be passed to a forked process once the process completes?

3. In a forked process do I need to be careful with passing by reference? Currently I'm passing a few variables (the LWP downloader and a spreadsheet::writeexcel method for output) by reference so as to reduce overhead.

4. Also do I need to be careful about multiple write calls on my workbook? Currently I am doing the outputing after processing each page with information.

Thanks for your help so far!