in reply to DB_File/BerkeleyDB with large datafiles

First I stored the complete file in XML format.

Are you saying you converted the original data into XML? Or the data comes to you in XML?

  • Comment on Re: DB_File/BerkeleyDB with large datafiles

Replies are listed 'Best First'.
Re^2: DB_File/BerkeleyDB with large datafiles
by Lowry76 (Novice) on Sep 20, 2010 at 17:26 UTC
    I converted it into XML. I parsed a huge file and wrote the information interesting for me to an XML file.
    But to retrieve information from this file I might have to read it in completely (if the dataset is the last one
    in the file). So I'm searching for something a little more convenient/faster but still just using flat files.
[reply]

      Storing data used for random retrieval in XML is ... um ... never going to work very well.

      (Some would say that storing data in XML is a mistake full stop--me amongst them--but don't let that put you off :)

      Could you show us one or two records of your data? Also, indicate how you need to retrieve them. Ie. By record number; or some embedded identifier; etc.

      Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
      "Science is about questioning the status quo. Questioning authority".
      In the absence of evidence, opinion is indistinguishable from prejudice.
[reply]
        Thanks but I guess I will try to do it like graff suggests (next reply). Might be most straight forward.
        If it doesn't work I will come back here ;-)
[reply]

In Section Seekers of Perl Wisdom