message queues

[huskers]

Hi,

I have a process(P1) which reads data from socket and puts it on a message queue. I have another process(P2) which reads from messsage queue and loads it into database. The rate at which P1 puts it on message queue is much higher than the rate at which P2 processes the data. I get error messages saying that P1 is unable to put messages on the queue as it is full. Is there any way that i could increase the efficieny like run two instances of P2 processes so that both of them simultaneouslt read from the message queue. When i did that i observed that only one of them pings to the message queue and the other one is getting locked out. Is there any parameter that i need to set when creating the message queue so that two or more processes can read it. Any suggestions are welcom.

Thanks in advance

 

[Wonboodoo]

What message queue software are you using? What is the maximum queue size? Why don't you bump up the maximum?

I don't think running multiple queues pullers is your answer. It may buy you a little more time, but you are still going to hit the max eventually. Don't assume that even if you work around the lock issue that you are going to double the throughput by running two processes. You won't.

Sounds to me like you have a fundamental design issue with your software architecture.

 

[Salem]

cross-posting won't help either
thread205-600657