When using normal Scrapy, duplicate filter can be disabled by just using dont_filter=True
dont_filter=True
I\'m using scrapy-redis and it is filtering the du
scrapy-redis
