amazon-sqs

See also Having a PHP script loop forever doing computing jobs from a queue system , but that doesn't answer all my questions. If I want to run a PHP script forever, accessing a queue and doing jobs: What is the potential for memory problems? How to avoid them? (any flush functions or something I should use?) What if the script dies for some reason? What would be a good method to automatically start it up again? What would be the best basic approach to start the script. Since it runs forever, I don't need cron. But how do I start it up? (See also 2.) Set the queue up as a cron script. Have it

I am using Akka Streams in Scala to poll from an AWS SQS queue using the AWS Java SDK . I created an ActorPublisher which dequeues messages on a two second interval: class SQSSubscriber(name: String) extends ActorPublisher[Message] { implicit val materializer = ActorMaterializer() val schedule = context.system.scheduler.schedule(0 seconds, 2 seconds, self, "dequeue") val client = new AmazonSQSClient() client.setRegion(RegionUtils.getRegion("us-east-1")) val url = client.getQueueUrl(name).getQueueUrl val MaxBufferSize = 100 var buf = Vector.empty[Message] override def receive: Receive = { case

I'm trying to create an SNS topic in one account and attach it to Config Rules. I have 3 such accounts and want to create SNS topic in each of the account. Now i want to subscribe all of the 3 topics of 3 different accounts by SQS of the fourth account. I'm able to do it manually. Can somebody please tell me how it can be done via boto3. Thanks in Advance. In order to subscribe a SNS topic present in Account A by an SQS present in Account B using boto3, following is the procedure. In Account A, create SNS topic and add the proper permission. For example, import boto3 sns_client = boto3.clien(

I have a SQS Queue from which messages are read by multiple hosts. I want to run some job (business logic) after all the messages in the queue have been processed. How can I check that the queue is empty? Yes, I can check for ApproximateNumberOfMessages and ApproximateNumberOfMessagesNotVisible queue attributes but these are approximate numbers. I want to stop my hosts polling for messages in the queue when there are no messages left and then run the required job. Any ideas? Thanks You could simply note empty receives from the API response while you're polling. Concerning CloudWatch, there is

I'm trying to wrap my head around the message queue model and jobs that I want to implement in a PHP app: My goal is to offload messages / data that needs to be sent to multiple third party APIs, so accessing them doesnt slow down the client. So sending the data to a message queue is ideal. I considered using just Gearman to hold the MQ/Jobs, but I wanted to use a Cloud Queue service like SQS or Rackspace Cloud Queues so i wouldnt have to manage the messages. Here's a diagram of what I think I should do: Questions: My workers, would be written in PHP they all have to be polling the cloud queue

I am currently struggle to find a solution for implement a specific kind of queue, which require the following traits: All queue must respect the order that job were added. The whole queue will have a concurrency of 1, which means that there will only be one job execute at a time per queue , not worker. There will be more than a few thousand queue like this. It need to be distributed and be able to scale (example if I add a worker) Basically it is a single process FIFO queue, and this is exactly what I want when tryout different message queue software like ActiveMQ or RabbitMQ, but as soon as