I have this web crawler that goes into a website and collects the links on the page and then does the same for every link creating a site map for the website. I have this pr
