libxml2 HTML chunk parsing

前提是你 提交于 2019-12-10 10:29:00

问题


I'm downloading HTML from a website. The file can be quite large so while the file's downloading, I want to already parse the available chunks of HTML so that the process appears faster for the end-user of my program. I don't have control over how the cunks are generated, so a chunk can begin in the middle of a word, e.g. like so:

chunk 1 --->  <div class="storyti
chunk 2 --->  tle"><a href="htt
chunk 3 --->  p://www.xkcd.com/">XKCD</a>
...and so on.

I have seen example where libxml2 was used to parse XML chunks exactly how I described. Can libxml2 also parse HTML chunks? I have checked with tidy on the html files I'm going to be downloading, it reports warnings but no errors. Can libxml2 parse those HTML chunks as well?


回答1:


libxml2 has a html parser which supports malformed/broken html. Please check the link here.




回答2:


If the content is XHTML, you can use libxml2 to parse it (since it is in fact XML). If it's regular HTML on the other hand, you'd have to use an SGML parser instead.




回答3:


Well, it seems it's not valid XHTML. Is there maybe some way to tidy HTML chunks?



来源:https://stackoverflow.com/questions/3483791/libxml2-html-chunk-parsing

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!