"be consistent" | |
PerlMonks |
Re^8: speeding up row by row lookup in a large dbby etj (Deacon) |
on Jun 03, 2022 at 22:10 UTC ( [id://11144377]=note: print w/replies, xml ) | Need Help?? |
There is a PDL module PDL::IO::DBI to make this straightforward. To make it scale Really Big, you'd probably need to read the data into something like CSV, then transform it into packed data, then memory-map that (on disk) using PDL::IO::FastRaw. Pull requests to make that more automatic would be most welcome!
In Section
Seekers of Perl Wisdom
|
|