How do you parse a web page and extract all the href links?

Question

I want to parse a web page in Groovy and extract all of the href links and the associated text with it.

If the page contained these links:

Answer 1

Parsing using XMlSlurper only works if HTMl is well-formed.

If your HTMl page has non-well-formed tags, then use regex for parsing the page.

Ex:

here, 'a' is not closed and thus not well formed.

 new URL(url).eachLine{
   (it =~ /.*/).each{
       // process hrefs
   }
}