How to find all links / pages on a website

Question

Is it possible to find all the pages and links on ANY given website? I\'d like to enter a URL and produce a directory tree of all links from that site?

I\'ve looked

Answer 1

If you have the developer console (JavaScript) in your browser, you can type this code in:

urls = document.querySelectorAll('a'); for (url in urls) console.log(urls[url].href);

Shortened:

n=$$('a');for(u in n)console.log(n[u].href)