Erlang/OTP Forums

Author Message

<  RabbitMQ mailing list  ~  Queue clustering

0x6e6562
Posted: Wed Nov 14, 2007 7:54 am Reply with quote
User Joined: 12 Jul 2007 Posts: 250
Dear list,

This is probably a stupid question, but why is mnesia not suitable for
backing queues?

Given that rabbit already uses mnesia to replicate exchange state, and
that you get a reference to the first and last items of a sorted
table, is there some obvious problem with using mnesia that I can't see?

Ben

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post recived from mailinglist
View user's profile Send private message
alexis
Posted: Wed Nov 14, 2007 1:15 pm Reply with quote
User Joined: 06 Sep 2007 Posts: 80 Location: London
Ben

We used logfiles to persist queues for speed and as a known best practice.

Using mnesia for persisting queues is a good idea for several reasons,
not least the manageability and quality of mnesia, but of course also
to provide several queue failover patterns 'out of the box'. Other
persistence models may also be attractive.

We'd planned to look at this in more detail after AMQP 0-10 is out
because that will define some of the failover and HA behaviours for
AMQP. Given that 0-10 is on its way soon, we've begun to look at this
informally, and would be delighted to move that discussion 'on list'.
What ideas would you recommend pursuing first? Our back-of-envelope
idea was, very simply, to see how a broker would perform with mnesia
instead of the current logger, using a bit of custom coding. This
might suggest good ways to go forward more systematically, and indeed
if this was even a good idea to pursue.

Thoughts?

alexis







On Nov 14, 2007 7:53 AM, Ben Hood <0x6e6562@gmail.com> wrote:
> Dear list,
>
> This is probably a stupid question, but why is mnesia not suitable for
> backing queues?
>
> Given that rabbit already uses mnesia to replicate exchange state, and
> that you get a reference to the first and last items of a sorted
> table, is there some obvious problem with using mnesia that I can't see?
>
> Ben
>
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss@lists.rabbitmq.com
> http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>



--
Alexis Richardson
+44 20 7617 7339 (UK)
+44 77 9865 2911 (cell)
+1 650 206 2517 (US)

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post recived from mailinglist
View user's profile Send private message Yahoo Messenger
alexis
Posted: Wed Nov 14, 2007 3:23 pm Reply with quote
User Joined: 06 Sep 2007 Posts: 80 Location: London
Ben

I've just been ticked off for my lack of clarity by a colleague Smile

To be clear - my remarks were intended to apply to both uses of Mnesia, i.e.

- for clustering queues as well as exchanges, in the transient case,
without necessarily committing to committing to disk
- for persistence in its several forms

alexis


On Nov 14, 2007 1:14 PM, Alexis Richardson
<alexis.richardson@cohesiveft.com> wrote:
> Ben
>
> We used logfiles to persist queues for speed and as a known best practice.
>
> Using mnesia for persisting queues is a good idea for several reasons,
> not least the manageability and quality of mnesia, but of course also
> to provide several queue failover patterns 'out of the box'. Other
> persistence models may also be attractive.
>
> We'd planned to look at this in more detail after AMQP 0-10 is out
> because that will define some of the failover and HA behaviours for
> AMQP. Given that 0-10 is on its way soon, we've begun to look at this
> informally, and would be delighted to move that discussion 'on list'.
> What ideas would you recommend pursuing first? Our back-of-envelope
> idea was, very simply, to see how a broker would perform with mnesia
> instead of the current logger, using a bit of custom coding. This
> might suggest good ways to go forward more systematically, and indeed
> if this was even a good idea to pursue.
>
> Thoughts?
>
> alexis
>
>
>
>
>
>
>
>
> On Nov 14, 2007 7:53 AM, Ben Hood <0x6e6562@gmail.com> wrote:
> > Dear list,
> >
> > This is probably a stupid question, but why is mnesia not suitable for
> > backing queues?
> >
> > Given that rabbit already uses mnesia to replicate exchange state, and
> > that you get a reference to the first and last items of a sorted
> > table, is there some obvious problem with using mnesia that I can't see?
> >
> > Ben
> >
> > _______________________________________________
> > rabbitmq-discuss mailing list
> > rabbitmq-discuss@lists.rabbitmq.com
> > http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
> >
>
>
>
> --
> Alexis Richardson
> +44 20 7617 7339 (UK)
> +44 77 9865 2911 (cell)
> +1 650 206 2517 (US)
>



--
Alexis Richardson
+44 20 7617 7339 (UK)
+44 77 9865 2911 (cell)
+1 650 206 2517 (US)

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post recived from mailinglist
View user's profile Send private message Yahoo Messenger

Display posts from previous:  

All times are GMT
Page 1 of 1
This forum is locked: you cannot post, reply to, or edit topics.

Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum