How to find URLs in HTML using Java

Question

I have the following... I wouldn\'t say problem, but situation.

I have some HTML with tags and everything. I want to search the HTML for every URL. I\'m doing it now by

Answer 1

Try using a HTML parsing library then search for tags in the HTML document.

Document doc = Jsoup.parse(input, "UTF-8", "http://example.com/");
Elements links = doc.select("a[href]"); // a with href

not all url are in tags, some are text and some are in links or other tags

You shouldn't scan the HTML source to achieve this.

You will end up with link elements that are not necessarily in the 'text' of the page, i.e you could end up with 'links' of JS scripts in the page for example.

Best way is still that you use a tool made for the job.

You should grab HTML tags and cover the most likely ones to have 'links' inside them (say:

,

,

etc) . HTML parsers provide regex-like functionalities to filter through the content of the tags, something similar to your logic of "starts with HTTP".

[attr^=value], [attr$=value], [attr*=value]: elements with attributes that start with, end with, or contain the value, e.g. select("[href*=/path/]")

See: jSoup.

0 讨论(0)

查看其它4个回答

发布评论:

提交评论

---

•  加载中...