Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?
 
PerlMonks  

Re^3: Memory efficient way to deal with really large arrays?

by LanX (Saint)
on Dec 13, 2020 at 19:01 UTC ( [id://11125132]=note: print w/replies, xml ) Need Help??


in reply to Re^2: Memory efficient way to deal with really large arrays?
in thread Memory efficient way to deal with really large arrays?

If you keep the pairs, i.e. 2 dim points, how would you want to sort them in one dimension?

> the OP hasn't told us yet what his final goal is!

Exactly!

For instance, if he wanted to process the data sequentially he could also sort them into HoHs or AoHs, since Perl is swapping out unused data.

Like this only the currently processed second level structure would be in RAM and the performance overhead for swapping would be negligible.

Cheers Rolf
(addicted to the Perl Programming Language :)
Wikisyntax for the Monastery

  • Comment on Re^3: Memory efficient way to deal with really large arrays?

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11125132]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others about the Monastery: (5)
As of 2024-04-19 10:19 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found