| Author |
Message |
|
| Guest |
 Posted: Mon Oct 12, 2009 8:18 pm |
 |
|
|
Guest
|
Hey all. I'm running into an issue with my rabbitMQ server. I have an inkling of what the problem might be but I wanted to run it by you folks. Some background, I'm running rabbitMB 1.6.0 [{running_applications,[{rabbit,"RabbitMQ","1.6.0"}, {mnesia,"MNESIA CXC 138 12","4.3.5"}, {os_mon,"CPO CXC 138 46","2.1.2.1"}, {sasl,"SASL CXC 138 11","2.1.5.1"}, {stdlib,"ERTS CXC 138 10","1.14.5"}, {kernel,"ERTS CXC 138 10","2.11.5"}]}, {nodes,[rabbit@neutrino]}, {running_nodes,[rabbit@neutrino]}] I'm using the Java client. I have an app that basically takes the Twitter firehose, throws every link it gets into an exchange, and that exchange throws the links to different bins depending on what the links are and who they're from. So the routing keys are typically [twitter_user_id].[link] (e.g. 1022101.http://google.com). Everything has been running wonderfully, but I recently noticed that rabbitMQ has been throwing frame errors every now and then. I have a sneaking suspicion that this is related to unicode characters in certain tweets (usually foreign language tweets). Would the fact that it's trying to run a binding check on an extremely long key be the cause for these errors? If not, what else might be the issue? Here's the error report for one of the crashes: =CRASH REPORT==== 6-Oct-2009::02:13:25 === crasher: pid: <0.1309.0> registered_name: [] error_info: {amqp,frame_error, "cannot decode <<0,1,9,109,97,105,110,116,114,....(this goes on forever, truncated for sanity's sake)>>", 'basic.publish'} initial_call: {gen,init_it, [gen_server2, <0.1308.0>, <0.1308.0>, rabbit_channel, [1,<0.1306.0>,<0.1307.0>,<<"firehose_pull">>,<<"/">>], []]} ancestors: [<0.1308.0>] messages: [] links: [<0.1307.0>] dictionary: [{permission_cache, [{{resource,<<"/">>,exchange,<<"maintrack">>},write}, {{resource,<<"/">>,exchange,<<"maintrack">>},read}, {{resource,<<"/">>,queue,<<"firehose">>},write}, {{resource,<<"/">>,queue,<<"firehose">>},configure}, {{resource,<<"/">>,exchange,<<"maintrack">>}, configure}]}, {guid,{{8,<0.1309.0>},0}}] trap_exit: true status: running heap_size: 6765 stack_size: 21 reductions: 921224340 neighbours: neighbour: [{pid,<0.1307.0>}, {registered_name,[]}, {initial_call,{rabbit_writer,mainloop,1}}, {current_function,{erlang,hibernate,3}}, {ancestors,[]}, {messages,[shutdown]}, {links,[<0.1309.0>]}, {dictionary,[]}, {trap_exit,false}, {status,runnable}, {heap_size,233}, {stack_size,0}, {reductions,76}] Thanks in advance!
--
Mark Nutter
612-205-1388
marknutter@gmail.com (marknutter@gmail.com)
http://nuttersmark.com
Post received from mailinglist |
|
|
| Back to top |
|
| Guest |
| Posted: Mon Oct 12, 2009 10:24 pm |
|
|
|
Guest
|
Mark,
Mark Nutter wrote:
> I'm using the Java client. I have an
> app that basically takes the Twitter firehose, throws every link it gets
> into an exchange, and that exchange throws the links to different bins
> depending on what the links are and who they're from. So the routing
> keys are typically [twitter_user_id].[link] (e.g.
> 1022101.http://google.com). Everything has been running wonderfully, but
> I recently noticed that rabbitMQ has been throwing frame errors every
> now and then. I have a sneaking suspicion that this is related to
> unicode characters in certain tweets (usually foreign language tweets).
> Would the fact that it's trying to run a binding check on an extremely
> long key be the cause for these errors? If not, what else might be the
> issue? Here's the error report for one of the crashes: =CRASH REPORT====
> 6-Oct-2009::02:13:25 === crasher: pid: <0.1309.0> registered_name: []
> error_info: {amqp,frame_error, "cannot decode
> <<0,1,9,109,97,105,110,116,114,....(this goes on forever, truncated for
> sanity's sake)>>", 'basic.publish'}
The server knows nothing about unicode; it just matches routing keys as
bitstrings.
How long do the routing keys get? The protocol limits them to 255 bytes.
That's not enforced by the Java client codec though, so if you supply a
routing key longer than that it will produce a malformed frame. I will
raise a bug to add some checks.
Regards,
Matthias.
_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist |
|
|
| Back to top |
|
|
|
All times are GMT
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum
|
|
|
Digg It
Del.icio.us
Reddit
Facebook
Stumble Upon
Technorati
