Thank you for your valuable input.
I am not reading a filesystem but issuing an omnidb command which will query HP Dataprotector database for backed up files. There problem here is that it does not support recursive listing. Which means I have to run the omnidb command for each found directory from the previous output. Having that said I can not populate the queue completely. As querying the db takes a lot of time I try to do that in parallel.
Would that still be doable with the normal way you just explained? Would you mind showing a small example?
Thanks a lot