queue

I'm developing a django IPN plugin that saves IPN data to a model and then calls a post_save signal. I'm worried that under this use case (gunicorn, gevent, etc) that the signals may be called/completed asynchronously. The IPN often sends more than 1 request to the ipn url, and I need to be able to process those requests in order. Should I use a queue for this? Would simple python queue's work better, or should I use something like kombu + celery (with 1 worker)? Not sure synchronicity is your real concern here. Django's signals are always executed in-process : that is, they will be executed

I have a program that is being symlinked to multiple directories e.g. /main/foo.pl /run1/foo.pl -> /main/foo.pl /run2/foo.pl -> /main/foo.pl /run3/foo.pl -> /main/foo.pl /run4/foo.pl -> /main/foo.pl They're being run as cron jobs, hence I have the following entries in the crontab: */2 * * * * /run1/foo.pl */2 * * * * /run2/foo.pl */2 * * * * /run3/foo.pl */2 * * * * /run4/foo.pl A snippet of foo.pl is as below: use Fcntl qw(:flock); use autodie qw(:all); open my $self, '>', "$FindBin::Bin/lockme"; flock( $self, LOCK_EX|LOCK_NB ) or die "Cannot acquire lock, already running!"; { my $long_proc =

I have supervisorctl managing some daemon queue workers with this configuration : [program:jobdownloader] process_name=%(program_name)s_%(process_num)03d command=php /var/www/microservices/ppsatoms/artisan queue:work ppsjobdownloader --daemon --sleep=0 autostart=true autorestart=true user=root numprocs=50 redirect_stderr=true stdout_logfile=/mnt/@@sync/jobdownloader.log Sometimes some workers are like hanging (running but stop getting queue messages) and supervisorctl does not automatically restart them, so I have to monitor and manually restart them. Is there something wrong with the

Is there a method/pattern/library to do something like that (in pseudo-code): task_queue.push_back(ObjectType object1, method1); task_queue.push_back(OtherObjectType object2, method2); so that I could do the something like: for(int i=0; i<task_queue.size(); i++) { task_queue[i].object -> method(); } so that it would call: obj1.method1(); obj2.method2(); Or is that an impossible dream? And if there's a way to add a number of parameters to call - that would be the best. Doug T. please see this Excellent answer! Dave Van den Eynde 's version works well too. Yes you would want to combine boost: