Erlang Mailing Lists

Author Message

<  RabbitMQ mailing list  ~  queue memory issues

Guest
Posted: Thu Nov 19, 2009 10:08 pm Reply with quote
Guest
Hi all,

I am using RabbitMQ to send data messages between 2 java applications in
2 different machines.
Sometimes the RabbitMQ broker crashes because the queues are too large,
due to large comunication cuts (days).
I tried using MessageProperties.PERSISTENT_BASIC when performing
basicPublish action, so it persists the messages to disk, but the
problem doesn't
solve by doing that.

I would really apreciate if someone could help me solve a couple of
questions (or tell me where to look at, I've looked up in the API and
docs, but couldn't find it):
a) how can I give more memory to the rabbit to store (both memory and
persistent) messages?
b) is it possible to make the queue discard old messages when queue
reaches it limit, so at least the RabbitMQ broker doesn't crash?

thanks in advance,


guillem



_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist
Guest
Posted: Fri Nov 20, 2009 12:38 am Reply with quote
Guest
Hi Guillem,

On Mon, Nov 16, 2009 at 07:24:23PM +0100, Guillem Corominas wrote:
> I am using RabbitMQ to send data messages between 2 java applications in
> 2 different machines.
> Sometimes the RabbitMQ broker crashes because the queues are too large,
> due to large comunication cuts (days).
> I tried using MessageProperties.PERSISTENT_BASIC when performing
> basicPublish action, so it persists the messages to disk, but the
> problem doesn't
> solve by doing that.

This is an oft reported problem, and a thorough solution has been worked
on for many months and is nearing completion. Currently, even persistent
messages are held in RAM. Persistent messages are also written out to
disk.

> I would really apreciate if someone could help me solve a couple of
> questions (or tell me where to look at, I've looked up in the API and
> docs, but couldn't find it):
> a) how can I give more memory to the rabbit to store (both memory and
> persistent) messages?

At the moment, other than increasing the amount of RAM in the server,
there is not much else you can do.

> b) is it possible to make the queue discard old messages when queue
> reaches it limit, so at least the RabbitMQ broker doesn't crash?

Sadly not, no. There is no TTL or expiry of messages, though that too is
an oft requested feature (alas, we have not started work on that yet).

Matthew

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist

Display posts from previous:  

All times are GMT
Page 1 of 1
This forum is locked: you cannot post, reply to, or edit topics.

Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum