sitemap

How to let sitemap generator fully crawl Angular router for SPA?

生来就可爱ヽ(ⅴ<●) 提交于 2019-12-05 04:24:15
I am trying to generate a sitemap for my webpage. The sitemap generators online only show me a homepage on xml file. <?xml version="1.0" encoding="UTF-8"?> -<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> -<url> <loc>http://margvel.com</loc> <priority>0.5</priority> </url> </urlset> my webpage meanwhile has several routes in angular. to see the webpage you could go to margvel.com I used couple of sitemap generators. xml-sitemap and botmap I checked botmap, because it should have SPA support. The links I want to create sitemap use material design and routerlink. the code looks like

how to parse a sitemap.xml file using scrapy's XmlFeedSpider?

为君一笑 提交于 2019-12-05 04:21:39
问题 I am trying to parse sitemap.xml files using scrapy, the sitemap files are like the following one with just much more url nodes. <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:video="http://www.sitemaps.org/schemas/sitemap-video/1.1"> <url> <loc> http://www.site.com/page.html </loc> <video:video> <video:thumbnail_loc> http://www.site.com/thumb.jpg </video:thumbnail_loc> <video:content_loc>http://www.example.com/video123.flv</video

Rails sitemap_generator Uninitialized Constant?

ぃ、小莉子 提交于 2019-12-05 00:10:17
问题 I'm trying to use the Rails site map_generator gem to generate site maps for a 8,000,00 page site. The gem can be found here: https://github.com/kjvarga/sitemap_generator Here is my code in sitemap.rb: require 'rubygems' require 'sitemap_generator' # Set the host name for URL creation SitemapGenerator::Sitemap.default_host = "http://www.mysite.com" SitemapGenerator::Sitemap.create do add '/content.aspx?page=privacypolicy' Product.find_each do |product| add product_path(ppid), :lastmod =>

How to properly format last modified (lastmod) time for xml sitemaps

余生颓废 提交于 2019-12-04 23:06:10
I am creating an app that will automatically update sitemap.xml each time new content is added to, or updated on the site. According to Google's best practices the <lastmod></lastmod> tag should be formatted as follows: <lastmod>2011-06-27T19:34:00+01:00</lastmod> My question concerns the time formatting itself. I understand the 2011-06-27T19:34:00 part. What I do not understand is the +01:00 , which I am assuming is the +/- UTC . Is this a correct assumption? My Time Zone Table looks like this: So if the site was based in #4 Afghanistan the correct time would be: 2011-06-27T19:34:00+04:00 And

How to create a Sitemap for CakePHP?

允我心安 提交于 2019-12-04 21:53:19
问题 I want to create a sitemap, but I know very little about the usage of Sitemaps. I use CakePHP. There is a lot software on google and guides, but I still want ask anyway, for an easy way to create sitemaps for CakePHP. I uploaded the website on the server, it doesn't rely on localhost. 回答1: Here's a quick'n'dirty example for you to play with and adjust to your needs: In your controller: public $components = array('RequestHandler'); public function sitemap() { Configure::write('debug', 0);

namespace prefix xhtml on link is not defined - sitemap.xml

馋奶兔 提交于 2019-12-04 19:34:27
问题 I am trying to add language to my sitemap.xml file, but I get a "namespace prefix xhtml on link is not defined" error. How do I defined it? I cannot find anything useful on google. Here is the file: <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd"> <!-- created with Free

Google Sitemap Date Format

吃可爱长大的小学妹 提交于 2019-12-04 17:03:55
问题 I need date format for sitemaps in php. How can i do that ? Is this output right ? <lastmod>2012-08-02EEST18:01:18+03:00</lastmod> 回答1: If you have the timestamp you can format the date correctly like this: <lastmod><?php echo date('c', $timestamp); ?></lastmod> Time stamp could be time() (for current time) or some other method of fetching a unix tiemstamp like strtotime() 回答2: To format the current timestamp in W3C Datetime encoding (as used in sitemap.xml files) use the following parameters

百度Sitemap生成器

一世执手 提交于 2019-12-04 13:34:09
今天用了两个小时, 为 无限影视 ( https://www.88tv.org )开发了一个小工具, 用来生成baidu的sitemap。 方便用。 因为该电影站的视频内容详情网页的ID是自增长的,所以可以按顺序快速生成。 不用再写爬虫去一个一个链接爬了。 1. 输入URL模板, 注意{*}, 这个是用来放ID的。 2. ID区间,要生成多少到多少的页面链接。 3. 排除ID: 排除这些ID。 4. 更新时间, 这是sitemap中的结构, 一般指该页面的更新时间。 频繁度=更新频繁度, 5. 这工具加入了其它内容, 方便整理视频栏目, 首页及其它页面的内容。 这个工具不用读数据库, 不用爬网站, 只要你的网站内容ID有规律就能用。 示例附件下载在末尾。 预览图: 事件代码: Common.PageInfo pg; if (cbChangefreq.Text == "") { MessageBox.Show("没有选择更新频率."); return; } List<Common.PageInfo> list = new List<Common.PageInfo>(); for (int i = (int)NuDMin.Value; i < NudMax.Value; i++) { if (((System.Collections.IList)rbtPC.Text.Split(','

Generate sitemap on the fly

不羁的心 提交于 2019-12-04 10:40:04
I'm trying to generate a sitemap.xml on the fly for a particular asp.net website. I found a couple solutions: chinookwebs cervoproject newtonking Chinookwebs is working great but seems a bit inactive right now and it's impossible to personalize the "priority" and the "changefreq" tags of each and every page, they all inherit the same value from the config file. What solutions do you guys use? Usually you'll use an HTTP Handler for this. Given a request for... http://www.yoursite.com/sitemap.axd ...your handler will respond with a formatted XML sitemap. Whether that sitemap is generated on the

Parse XML to UL

◇◆丶佛笑我妖孽 提交于 2019-12-04 09:22:24
I am trying to use JQuery to parse a sitemap.xml to look like this HTML: http://astuteo.com/slickmap/demo/ After working on it for a few hours I decided I really need some help in the right direction. the main template it has is this, where each indent is a different directory level: <ul id="primaryNav" class="col4"> <li id="home"><a href="http://sitetitle.com">Home</a></li> <li><a href="/services">Services</a> <ul> <li><a href="/services/design">Graphic Design</a></li> <li><a href="/services/development">Web Development</a></li> <li><a href="/services/marketing">Internet Marketing</a> <ul>