Re: Not able to put more than 10k uncommited messages in queue

I suggest that you modify your approach. You are most likely running into an architectural “big enough” limit, and it is probably going to be necessary for you to commit smaller batches. The logic on the receiving end would have to understand that the mere receipt of a particular block of messages does not necessarily mean that the transmission is complete. Instead, you would need to devise a message that corresponds to the radio-operator’s familiar, “over...” For instance, ten blocks of 1,000 messages each, then, “over ...” The receiver would have to have a place (aside from the queue) in which to buffer the received stream until it finally received “over...”

Replies are listed 'Best First'.
Re^2: Not able to put more than 10k uncommited messages in queue by locked_user sundialsvc4 (Abbot) on Jul 13, 2014 at 20:49 UTC
To answer a private-messaged question: What you are doing here is eliminating any issues imposed by the architectural limits of the queue. Send units of work across the wire in chunks of convenient and sensible size. Accumulate them all. When the receiver hears “over,” it acts upon them as a single atomic unit-of-work. (And, say, if it hears “forget that,” instead, then it throws-away what it had heard and ignores it, as instructed.) Don’t let the messages be “unduly large,” such that this conversation becomes a “million-pound elephant” for the queueing infrastructure. Just send reasonably-sized chunks, as many as may be necessary.

Replies are listed 'Best First'.

Re^2: Not able to put more than 10k uncommited messages in queue
by locked_user sundialsvc4 (Abbot) on Jul 13, 2014 at 20:49 UTC

To answer a private-messaged question:

What you are doing here is eliminating any issues imposed by the architectural limits of the queue. Send units of work across the wire in chunks of convenient and sensible size. Accumulate them all. When the receiver hears “over,” it acts upon them as a single atomic unit-of-work. (And, say, if it hears “forget that,” instead, then it throws-away what it had heard and ignores it, as instructed.)

Don’t let the messages be “unduly large,” such that this conversation becomes a “million-pound elephant” for the queueing infrastructure. Just send reasonably-sized chunks, as many as may be necessary.