I have written a crawler to crawl a locally hosted website. In its single thread version it works, albeit really slow. I\'m trying to make it multi-thread. Here is the code
