message-queue

What's the fastest Perl IPC/message queue for a single machine?

ぃ、小莉子 提交于 2019-12-04 14:01:37
问题 I'm working on a (primarily) Perl project and want to use a message queue to isolate processes from each other. I have a work flow like this: Input -> Receiver -> Processor(s) -> Output(s) I need to handle several hundred transactions/second, so speed my biggest motivator. What is the fastest message queue system for this type of setup? All of my processes run on the same machine, so I can use UNIX sockets or temp-files if it means better performance. So far my two favorites are IPC::DirQueue

RabbitMQ plugin to remove duplicate messages

这一生的挚爱 提交于 2019-12-04 13:19:18
问题 I have a RabbitMQ queues for documents generation. Basically, each document has type and state (new, processing, ready), so I use topic exchange with routing keys like type.state . Every time document changes I send the message with last document description to the exchange and it works good enough. However sometimes document can be processed twice: User send new document. So new message report.new is sent to exchange. While worker hasn't started document processing (the queue hasn't yet

HornetQ Core API and JMS

梦想与她 提交于 2019-12-04 13:03:31
I have few questions regarding HornetQ: What are differences between HornetQ core API and the JMS API ? is there any advantage or disadvantage on using one of these ? Is it true to say if I use the core API and then I decide to change my Messaging Bus (let's say to ActiveMQ) then I have to change all my codes ? HornetQ Core API is a proprietary API from HornetQ, while the JMS API is a standard API defined by the Java Community Process. There are a few features that are not supported on JMS API, that are available through core-api: It's not possible to have multiple consumers on a single topic

MSMQ vs Temporary Table Dump

帅比萌擦擦* 提交于 2019-12-04 12:01:20
问题 I know this question has been asked a bit before. But looking around I still cant make my mind up which route I should go down. Here's my scenario, hopefully you can help out: We will have a series of web services that will be hit on a scheduled basis by hundreds of mobile applications. These services will data on the device with new information both going to the devices and coming back from them. The data returned from the devices will need to update a single central SQL server database that

Do messages in dead letter queues in Azure Service Bus expire?

天涯浪子 提交于 2019-12-04 11:15:48
问题 Do messages in dead letter queues in Azure Service Bus expire? Some explanation I have these queue settings: var queueDescription = new QueueDescription("MyTestQueue") { RequiresSession = false, DefaultMessageTimeToLive = TimeSpan.FromMinutes(1), EnableDeadLetteringOnMessageExpiration = true, MaxDeliveryCount = 10 }; namespaceManager.CreateQueue(queueDescription); When I place some messages in a Azure Service Bus message queue (not queues from Azure Storage) and don't consume them (ever),

Locks and batch fetch messages with RabbitMq

回眸只為那壹抹淺笑 提交于 2019-12-04 10:47:13
问题 I'm trying to use RabbitMq in a more unconventional way (though at this point i can pick any other message queue implementation if needed). Instead of leaving Rabbit push messages to my consumers, the consumer connects to a queue and fetches a batch of N messages (during which it consumes some and possible rejects some), after which it jumps to another queue and so on. This is done for redundancy. If some consumers crash all messages are guaranteed to be consumed by some other consumer. The

MessageQueue and Async / Await

你说的曾经没有我的故事 提交于 2019-12-04 10:31:30
问题 I only want to receive my message in a async method! and its freezing my UI public async void ProcessMessages() { MessageQueue MyMessageQueue = new MessageQueue(@".\private$\MyTransactionalQueue"); MyMessageQueue.Formatter = new XmlMessageFormatter(new Type[] { typeof(string) }); while (true) { MessageQueueTransaction MessageQueueTransaction = new MessageQueueTransaction(); MessageQueueTransaction.Begin(); ContainError = false; ProcessPanel.SetWaiting(); string Body = MyMessageQueue.Receive

Are there any Python 2.7 alternatives to ZeroMQ that are released under the BSD or MIT license?

梦想的初衷 提交于 2019-12-04 10:16:40
I am seeking Python 2.7 alternatives to ZeroMQ that are released under the BSD or MIT license. I am looking for something that supports request-reply and pub-sub messaging patterns. I can serialize the data myself if necessary. I found Twisted from Twisted Matrix Labs but it appears to require a blocking event loop, i.e. reactor.run(). I need a library that will run in the background and let my application check messages upon certain events. Are there any other alternatives? Give nanomsg , a ZeroMQ younger sister, a try - same father, same beauty Yes, it is licensed under MIT /X11 license. Yes

Difference between using Message Queue vs Plain Cron Jobs with PHP

蓝咒 提交于 2019-12-04 09:34:44
问题 We have a large web application built on PHP. This application allows scheduling tweets and wall posts and there are scheduled emails that go out from the server. By 'scheduled', I mean that these are PHP scripts scheduled to run at particular time using cron . There are about 7 PHP files that do the above jobs. I have been hearing about Message Queues. Can anyone explain if Message Queues are the best fit in this scenario? Do Message Queues execute PHP scripts? or do we need to configure

AMQP Delay Delivery and Prevent Duplicate Messages

早过忘川 提交于 2019-12-04 09:29:28
I have a system that will generate messages sporadically, and I would like to only submit either zero or one message every 5 minutes. If no message is generated, nothing would be processed by the queue consumer. If a hundred identical messages are generated within 5 minutes I only want one of those to be consumed from the queue. I am using AMQP(RabbitMQ), is there a way to accomplish this within rabbitmq or the AMQP protocol? Can I inspect a queue's contents to ensure that I don't insert a duplicate? It seems that queue inspection is a bad idea and not typically what should be done for a