in reply to Framework for handling vast reams of tabular data.

Perl is the solution for you. Curtesy of Data Type: Hash, you can store serially retrieved data in a variety of representations, later sorting each representation as you wish.
  • Comment on Re: Framework for handling vast reams of tabular data.