in reply to Alternative for multiple while loops to improve performance

I agree with the previous commenters regarding making sure that you have an optimized database. Correct indices are critical

Since you haven't provided any perl code, we can't give you very much advice. What I can offer, is that I often read data from a database and load it into a perl HashRef that is shaped in a way to allow me to access the data very directly for my purpose. This assumes that the data can fit within memory. See perlref and perlreftut for information on references if you are not familiar with them.

Cheers, lbe

  • Comment on Re: Alternative for multiple while loops to improve performance

Replies are listed 'Best First'.
Re^2: Alternative for multiple while loops to improve performance
by afoken (Chancellor) on Dec 19, 2018 at 19:25 UTC
    I often read data from a database and load it into a perl HashRef that is shaped in a way to allow me to access the data very directly for my purpose. This assumes that the data can fit within memory.

    Depending on your data, this can be a huge waste of resources. As a general rule of thumb, try not to fetch more data than you really need from the database, and let the database sort, filter, and aggregate the data as much as possible.

    Alexander

    --
    Today I will gladly share my knowledge and experience, for there are no sweeter words than "I told you so". ;-)
[reply]

In Section Seekers of Perl Wisdom