sitemap

Generating a Visual Site Map of an Existing Site

由 ￡可爱￡侵袭症＋ 提交于 2019-12-04 02:47:15
I thought I could easily answer this question by searching the web, but my Google-fu has failed me. So I turn to you, oh mighty stackoverflowers, and beseech you for enlightenment: What is the quickest and best way to generate a visual site map (e.g. flowchart, mind map, IA diagram) of an existing website? Additional context: my client has been asked by their client to redesign their website. The art directors understandably asked for information on the current site architecture, to which the client had nothing(!). So they have asked me to automagically produce a visual site map by somehow

XSLT does not work when I include xmlns=“http://www.sitemaps.org/schemas/sitemap/0.9”

由 不想你离开。 提交于 2019-12-04 00:45:56
My Google sitemap renders well through XSLT fine without the xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" in the < urlset > element, however when included, my foreach statement doesn't work and nothing renders in the template. My code's below. Thanks for your help. XML <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> <url> <loc>{site_url}</loc> <lastmod>{current_time format="%Y-%m-%d"}</lastmod> <changefreq>monthly</changefreq> <priority>0.5</priority> </url> </urlset> XSL <xsl:template match="/"> <html> <body> <h2>Sitemap</h2> <table border="1"> <tr bgcolor="#9acd32"> <th

Scrapy crawl all sitemap links

由 馋奶兔 提交于 2019-12-03 23:12:12
问题 I want to crawl all he links present in the sitemap.xml of a fixed site. I've came across Scrapy's SitemapSpider . So far i've extracted all the urls in the sitemap. Now i want to crawl through each link of the sitemap. Any help would be highly useful. The code so far is: class MySpider(SitemapSpider): name = "xyz" allowed_domains = ["xyz.nl"] sitemap_urls = ["http://www.xyz.nl/sitemap.xml"] def parse(self, response): print response.url 回答1: You need to add sitemap_rules to process the data

how to parse a sitemap.xml file using scrapy's XmlFeedSpider?

由 女生的网名这么多〃 提交于 2019-12-03 20:40:38
I am trying to parse sitemap.xml files using scrapy, the sitemap files are like the following one with just much more url nodes. <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:video="http://www.sitemaps.org/schemas/sitemap-video/1.1"> <url> <loc> http://www.site.com/page.html </loc> <video:video> <video:thumbnail_loc> http://www.site.com/thumb.jpg </video:thumbnail_loc> <video:content_loc>http://www.example.com/video123.flv</video:content_loc> <video:player_loc allow_embed="yes" autoplay="ap=1"> http://www.example.com/videoplayer.swf

Rails sitemap_generator Uninitialized Constant?

由 风流意气都作罢 提交于 2019-12-03 16:52:02
I'm trying to use the Rails site map_generator gem to generate site maps for a 8,000,00 page site. The gem can be found here: https://github.com/kjvarga/sitemap_generator Here is my code in sitemap.rb: require 'rubygems' require 'sitemap_generator' # Set the host name for URL creation SitemapGenerator::Sitemap.default_host = "http://www.mysite.com" SitemapGenerator::Sitemap.create do add '/content.aspx?page=privacypolicy' Product.find_each do |product| add product_path(ppid), :lastmod => content.updated_at end end However, when I run >> ruby sitemap.rb I get an error that says: sitemap.rb:9:in

Validation of XML Sitemap urlset with xhtml:link inside url element

由 寵の児 提交于 2019-12-03 16:33:52
I am trying to create a sitemap such as the below and I get this error: <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml" xhtml:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd"> <url> <loc>http://www.something.com/something</loc> <xhtml:link rel="alternate" hreflang="en-us" href="http://www.something.com/something" /> </url> </urlset> Error: http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd "> ^ Error 1866: Element '{ http://www

How to create a Sitemap for CakePHP?

由 本小妞迷上赌 提交于 2019-12-03 13:44:06
I want to create a sitemap, but I know very little about the usage of Sitemaps. I use CakePHP. There is a lot software on google and guides, but I still want ask anyway, for an easy way to create sitemaps for CakePHP. I uploaded the website on the server, it doesn't rely on localhost. Here's a quick'n'dirty example for you to play with and adjust to your needs: In your controller: public $components = array('RequestHandler'); public function sitemap() { Configure::write('debug', 0); $articles = $this->Article->getSitemapInformation(); $this->set(compact('articles')); $this->RequestHandler-

Sitemap for a site with a large number of dynamic subdomains

由 房东的猫 提交于 2019-12-03 13:33:43
问题 I'm running a site which allows users to create subdomains. I'd like to submit these user subdomains to search engines via sitemaps. However, according to the sitemaps protocol (and Google Webmaster Tools), a single sitemap can include URLs from a single host only. What is the best approach? At the moment I've the following structure: Sitemap index located at example.com/sitemap-index.xml that lists sitemaps for each subdomain (but located at the same host). Each subdomain has its own sitemap

namespace prefix xhtml on link is not defined - sitemap.xml

由 喜你入骨 提交于 2019-12-03 12:31:14
I am trying to add language to my sitemap.xml file, but I get a "namespace prefix xhtml on link is not defined" error. How do I defined it? I cannot find anything useful on google. Here is the file: <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd"> <!-- created with Free Online Sitemap Generator www.xml-sitemaps.com --> <url> <loc>https://www.leepio.dk/</loc> </urlset>

Google Sitemap Date Format

由 你。 提交于 2019-12-03 09:59:49
I need date format for sitemaps in php. How can i do that ? Is this output right ? <lastmod>2012-08-02EEST18:01:18+03:00</lastmod> If you have the timestamp you can format the date correctly like this: <lastmod><?php echo date('c', $timestamp); ?></lastmod> Time stamp could be time() (for current time) or some other method of fetching a unix tiemstamp like strtotime() To format the current timestamp in W3C Datetime encoding (as used in sitemap.xml files) use the following parameters. echo date('Y-m-dTH:i:sP', time()); As of PHP5 you can also use the c format character to print the exact same
订阅 sitemap