in reply to Re: DB_File/BerkeleyDB with large datafiles
in thread DB_File/BerkeleyDB with large datafiles

I converted it into XML. I parsed a huge file and wrote the information interesting for me to an XML file.
But to retrieve information from this file I might have to read it in completely (if the dataset is the last one
in the file). So I'm searching for something a little more convenient/faster but still just using flat files.
  • Comment on Re^2: DB_File/BerkeleyDB with large datafiles

Replies are listed 'Best First'.
Re^3: DB_File/BerkeleyDB with large datafiles
by BrowserUk (Patriarch) on Sep 20, 2010 at 17:46 UTC

    Storing data used for random retrieval in XML is ... um ... never going to work very well.

    (Some would say that storing data in XML is a mistake full stop--me amongst them--but don't let that put you off :)

    Could you show us one or two records of your data? Also, indicate how you need to retrieve them. Ie. By record number; or some embedded identifier; etc.


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.
      Thanks but I guess I will try to do it like graff suggests (next reply). Might be most straight forward.
      If it doesn't work I will come back here ;-)