I\'m trying to run my crawler on multiple threads -
def parsePage(self, soup): for link in soup.findAll(\'a\'): if link.get(\'href\') is None: