I am trying to write a web crawler that stores the data in an inverted index object. However it is very slow, it takes about just over a second to crawl one website. I am us
