Erlang Mailing Lists

Author Message

<  RabbitMQ mailing list  ~  Priorities support in RabbitMQ

Guest
Posted: Fri Aug 28, 2009 3:42 pm Reply with quote
Guest
Hi,

I've been analyzing support of message priorities by RabbitMQ and the
only
information I've found is the document describing compatibility with
AMQP
specification (http://www.rabbitmq.com/specification.html), which states
that "server MUST implement at least 2 priority levels for basic
messages"
and RabbitMQ currently is in the stage of "planned". I assume there is
no
support for priorities in RabbitMQ currently. However could any one
tell me
something more about this? When it possibly could be included in
official
release? I'd really appreciate knowing more details on this as it's a
feature probably desired by many.

Best regards,
Michal Chruszcz
mchruszcz@gmail.com
mobile: +48 607 620 771
phone: +48 22 849 30 26


_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist
Guest
Posted: Fri Aug 28, 2009 3:48 pm Reply with quote
Guest
Hi Michal,

On Fri, Aug 28, 2009 at 05:41:43PM +0200, Michal Chruszcz wrote:
> I've been analyzing support of message priorities by RabbitMQ and the
> only
> information I've found is the document describing compatibility with
> AMQP
> specification (http://www.rabbitmq.com/specification.html), which states
> that "server MUST implement at least 2 priority levels for basic
> messages"
> and RabbitMQ currently is in the stage of "planned". I assume there is
> no
> support for priorities in RabbitMQ currently. However could any one
> tell me
> something more about this? When it possibly could be included in
> official
> release? I'd really appreciate knowing more details on this as it's a
> feature probably desired by many.

Yes, you're right, RabbitMQ does not support message priorities at all
at the moment, and yes, it is a fairly oft requested feature. We do have
plans to add support for it, but we don't have a release target for it
just yet. I'm afraid I don't have any more information that than -
basically: yes, we know people want it; yes, it's on our todo list; no,
we don't know when it'll get done.

Matthew

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist
Guest
Posted: Mon Aug 31, 2009 8:29 am Reply with quote
Guest
On Aug 28, 2009, at 5:48 PM, Matthew Sackman wrote:

> Hi Michal,
>
> On Fri, Aug 28, 2009 at 05:41:43PM +0200, Michal Chruszcz wrote:
>> I've been analyzing support of message priorities by RabbitMQ and the
>> only
>> information I've found is the document describing compatibility with
>> AMQP
>> specification (http://www.rabbitmq.com/specification.html), which
>> states
>> that "server MUST implement at least 2 priority levels for basic
>> messages"
>> and RabbitMQ currently is in the stage of "planned". I assume there
>> is
>> no
>> support for priorities in RabbitMQ currently. However could any one
>> tell me
>> something more about this? When it possibly could be included in
>> official
>> release? I'd really appreciate knowing more details on this as it's a
>> feature probably desired by many.
>
> Yes, you're right, RabbitMQ does not support message priorities at all
> at the moment, and yes, it is a fairly oft requested feature. We do
> have
> plans to add support for it, but we don't have a release target for it
> just yet. I'm afraid I don't have any more information that than -
> basically: yes, we know people want it; yes, it's on our todo list;
> no,
> we don't know when it'll get done.


Thank you for the answer. This makes things quite clear. Then I just
have to keep my fingers crossed and hope it'll be supported as soon as
possible.

Michal Chruszcz
mchruszcz@gmail.com
mobile: +48 607 620 771
phone: +48 22 849 30 26


_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist
Guest
Posted: Mon Aug 31, 2009 8:50 am Reply with quote
Guest
Michal,

Michal Chruszcz wrote:
> On Aug 28, 2009, at 5:48 PM, Matthew Sackman wrote:
>> RabbitMQ does not support message priorities at all
>
> Thank you for the answer. This makes things quite clear. Then I just
> have to keep my fingers crossed and hope it'll be supported as soon as
> possible.

What do you want to use priorities for? Depending on your use case there
could be some fairly straightforward approaches to emulate priorities
with the current RabbitMQ releases.


Regards,

Matthias.

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist
Guest
Posted: Mon Aug 31, 2009 11:35 am Reply with quote
Guest
On Aug 31, 2009, at 10:50 AM, Matthias Radestock wrote:

> Michal,
>
> Michal Chruszcz wrote:
>> On Aug 28, 2009, at 5:48 PM, Matthew Sackman wrote:
>>> RabbitMQ does not support message priorities at all
>> Thank you for the answer. This makes things quite clear. Then I
>> just have to keep my fingers crossed and hope it'll be supported
>> as soon as possible.
>
> What do you want to use priorities for? Depending on your use case
> there could be some fairly straightforward approaches to emulate
> priorities with the current RabbitMQ releases.


Think so? I've been looking for *something* that could enable me to
control order of message processing. Say I have distributed
asynchronous data processing service, which uses RabbitMQ for queueing
tasks, and would like to prioritize them depending on data volume
(tiny packages are processed first). Priorities seemed to be perfect
solution, but unfortunately later I realized it's not supported yet.

Michal Chruszcz
mchruszcz@gmail.com
mobile: +48 607 620 771
phone: +48 22 849 30 26


_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist
Guest
Posted: Mon Aug 31, 2009 12:20 pm Reply with quote
Guest
Michal Chruszcz wrote:
> control order of message processing. Say I have distributed
> asynchronous data processing service, which uses RabbitMQ for queueing
> tasks, and would like to prioritize them depending on data volume
> (tiny packages are processed first). Priorities seemed to be perfect
> solution, but unfortunately later I realized it's not supported yet.

It is a common misconception that priorities alone can be used to do this
"properly" - it will only work well if you are accidentally lucky with
your ingress patterns or really don't care about a total lack of
predictable processing latency for larger messages. Since Rabbit does not
page to disk yet, preferring small messages might even make it run out of
memory *sooner* as more and more large messages are held back. Do not
underestimate the effectiveness of randomized workloads. Smile
Explicitly moding this with multiple queues and multiple consumers is much
more likely to result in better (both predictable and controllable)
scalability and a well-balanced throughput for both small and large
messages. Spin up multiple consumers for small messages (keeping those
cores busy and even hopefully reducing per-message latency), have one
low-priority consumer chew on larger tasks in the background or even on
another machine. It also gives you the option of having different
durability/persistence options for different priorities.

-h

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist
Guest
Posted: Mon Aug 31, 2009 1:10 pm Reply with quote
Guest
On Mon, Aug 31, 2009 at 13:34, Michal Chruszcz<mchruszcz@gmail.com> wrote:
> Think so? I've been looking for *something* that could enable me to
> control order of message processing. Say I have distributed
> asynchronous data processing service, which uses RabbitMQ for queueing
> tasks, and would like to prioritize them depending on  data volume
> (tiny packages are processed first). Priorities seemed to be perfect
> solution, but unfortunately later I realized it's not supported yet.

Some people just create many queues, one for each priority.
Than they poll queues in proper order, so that the higher priority
queue is always served before low priority one.
Will that work for you?

Marek Majkowski

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss

Post received from mailinglist
Guest
Posted: Tue Sep 01, 2009 12:33 pm Reply with quote
Guest
On Aug 31, 2009, at 2:19 PM, Holger Hoffst
wuji
Posted: Wed Sep 05, 2012 4:40 am Reply with quote
User Joined: 10 Aug 2012 Posts: 654
down with some sledding, one of his favorite hobbies."I went went cheap jordan shoes went up to the mountain with some friends and started
sled, and I decided to try sledding head first," he he designer replica *beep* he recalled. "On my second try, I went down the
I lost complete control of the sled. I went into into [h1]Cheap Ralph Lauren Shirts[/h1] into a grove of trees, and instead of hitting the
with my face, I turned to my back at the the designer replica *beep* the very last second."What came after the impact was the
thing he could have ever imagined."I was starting to spit spit [h3]discount designer *beep*[/h3] spit up blood; the trees were spinning and worst of
I couldn't feel my legs."While Denniston sat motionless on the the [h3]discount designer *beep*[/h3] the snow, he recalled, an avalanche of possible scenarios flashed
his mind. "Would I be confined to a wheelchair, or or cheap jordans free shipping or will I actually die?" he asked himself."One of the
View user's profile Send private message

Display posts from previous:  

All times are GMT
Page 1 of 1
This forum is locked: you cannot post, reply to, or edit topics.

Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum