in reply to Efficient but elegant Cross-Product iterator ?

I am sure whatever you end up doing, PDL will make things a little easier for you.
  • Comment on Re: Efficient but elegant Cross-Product iterator ?

Replies are listed 'Best First'.
Re^2: Efficient but elegant Cross-Product iterator ?
by etj (Priest) on Apr 21, 2022 at 08:20 UTC
    The thing PDL is best for is rectangular, in-memory data. Then you can achieve incredibly terse, powerful, fast-running code. Iterators are a bit of a roadblock to this, though with sufficient "chunking" to read blocks of data and processing those (if the application allows), it may still be possible.

    If you want to work with gigantic data that sufficiently appears "in-memory", there's memory-mapping with PDL::IO::FastRaw.