in reply to load a file in memory and extract parts
You might want to clarify your statement of your initial quantities.
I (perhaps carelessly) first read "100mb 60k rows)" as 1 x 106 (aka '1.e+6' aka 'one million') rows, each with 10 columns. Unless most of the columns contain only a single character (or something close thereto), you're looking at a lot to slurp ... which see using Super Search here.
But a "mb" can mean 10242 bytes or 1,000,000 (decimal) bytes (often used by manufacturers of hard disks and computers to exagerate the size of their product)... and in any case, it's not conventionally used to [state|discuss|evaluate] a pure number.
|
|---|