in reply to Re^3: Storable problem of data sharing in multiprocess (only parent partitions jobs)
in thread Storable problem of data sharing in multiprocess

As jellisi2 said, this script will not work, and also will makes the script more difficult to run because maybe it will crawl a single page many many times.
  • Comment on Re^4: Storable problem of data sharing in multiprocess (only parent partitions jobs)

Replies are listed 'Best First'.
Re^5: Storable problem of data sharing in multiprocess (only parent partitions jobs)
by Anonymous Monk on Oct 04, 2014 at 02:03 UTC

    As jellisi2 said, this script will not work, and also will makes the script more difficult to run because maybe it will crawl a single page many many times.

    well, jellisi2 did not say that, and its not true anyway, it most definitely will work