in reply to Working with large number of small constantly updated records

See PgQ (pdf) for an interesting look at the various ways of implementing message queues on top of an RDBMS (handily Pg), along with their limitations and finally their solution--which they naturally claim addresses all the limitations.

Their solution is OSS (BSD) but in Python. If that's a barrier, then at least their design and analysis may be of interest.


Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
"Too many [] have been sedated by an oppressive environment of political correctness and risk aversion."
  • Comment on Re: Working with large number of small constantly updated records

Replies are listed 'Best First'.
Re^2: Working with large number of small constantly updated records
by erix (Prior) on May 01, 2009 at 19:20 UTC

    For a wider overview, incl. pgq, see also this talk about the very scalable Skype architecture.

    update: fixed that link. thanks :) (much more interesting stuff on that wiki, btw)