in reply to Sqlite: Threads and inserts into a different database for each one. (1 thread fast, >1 slow)

I suspect that the problem with slowness has little or nothing to do with your use of sqllite, and almost everything to do with poor coding choices with respect to shared data and queues.

I further suspect that -- subject to verifying my quesswork regarding the chunks of your code that you haven't posted -- that a few, relatively minor changes could effect a considerable speedup in the run time of this code.

Once again, can I suggest that you fill in the blanks so we stand some chance of actually helping you. Assuming you actually want help?

With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
  • Comment on Re: Sqlite: Threads and inserts into a different database for each one. (1 thread fast, >1 slow: BY YOUR DESIGN!)

Replies are listed 'Best First'.
Re^2: Sqlite: Threads and inserts into a different database for each one. (1 thread fast, >1 slow: BY YOUR DESIGN!)
by ssc37 (Acolyte) on Apr 07, 2014 at 15:17 UTC
    Sure, sure,
    I just try to reduce the part of the code who i haven't provided and construct a sample dataset (but i have difficulties to construct it from scratch)

    I'm pretty sure you're right about the "poor coding choices" because i'm a beginner and i scratch my head since days to try to figure out where i've made mistakes.

    May i join some tabulate files for the data than i retrieve from mysql? it will help me a lot

    Os: linux debian Perl: v5.14.2 Best regards,
[reply]
      May i join some tabulate files for the data than i retrieve from mysql? it will help me a lot

      Sorry, but I do not understand that question -- it seems to have lost a lot in translation. would you try re-phrasing it for us?

      With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
      Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
      "Science is about questioning the status quo. Questioning authority".
      In the absence of evidence, opinion is indistinguishable from prejudice.
[reply]
        The datas than i need to process comes from a mysql database.
        I was asking if it was helpful to upload a sample dataset or the full script is sufficient to analyse where i'm doing wrong?
        Thanks for taking time,
        Br,
[reply]

In Section Seekers of Perl Wisdom