Can I use WGET to generate a sitemap of a website given its URL?

后端 未结 2 1160
长发绾君心
长发绾君心 2021-02-03 10:42

I need a script that can spider a website and return the list of all crawled pages in plain-text or similar format; which I will submit to search engines as sitemap. Can I use W

2条回答
  •  無奈伤痛
    2021-02-03 11:19

    You can use this perl script to do the trick : http://code.google.com/p/perlsitemapgenerator/

提交回复
热议问题