Re: Memory Efficient Sparse Matrix Handling

I usually reach for PDL in situations like this. It allows you to program in perl, but all the hard stuff is hidden in well-optimized c-libraries.

Comment on Re: Memory Efficient Sparse Matrix Handling

Replies are listed 'Best First'.
Re^2: Memory Efficient Sparse Matrix Handling by ikegami (Patriarch) on Jan 26, 2009 at 17:40 UTC
The raw data for a 10^7 x 10^2 array takes up 1_000_000_000 bytes of data per byte of the data type. For most data types, that's more than a 32-bit machine can handle, regardless of whether C, PDL or Perl. That's why a sparse matrix was requested. PDL could very well have such a data structure, but it's not "well optimized C libraries" that are going to make the difference.	[reply]