carrot

Celery (Django) Rate limiting

扶醉桌前 提交于 2019-12-08 16:07:21
问题 I'm using Celery to process multiple data-mining tasks. One of these tasks connects to a remote service which allows a maximum of 10 simultaneous connections per user (or in other words, it CAN exceed 10 connections globally but it CANNOT exceed 10 connections per individual job). I THINK Token Bucket (rate limiting) is what I'm looking for, but I can't seem to find any implementation of it. 回答1: Celery features rate limiting, and contains a generic token bucket implementation. Set rate