We’re facing issues.
Parallel processing of multiple sites web crawling each site with 10k + products and 100’s of sites 3/4 times a week to keep database of products