sitemap

Should a highly dynamic website that is constantly generating new pages use a sitemap ? If so, how does a site like stackoverflow.com go about regenerating a sitemap? It seems like it would be a drain on precious server resources if it was constantly regenerating a sitemap every time someone adds a question. Does it generate a new sitemap at set intervals (e.g. every four hours)? I'm very curious how large, dynamic websites make this work. On Stackoverflow (and all Stack Exchange sites), a sitemap.xml file is created which contains a link to every question posted on the system. When a new

I need to generate a sitemap in a Codeigniter application. I found a few libraries but all of them are outdated and have bug. Do I really need a separate library for this? I want to know the best way to generate the sitemap in Codeigniter . roev You can use my code: controllers/seo.php Class Seo extends CI_Controller { function sitemap() { $data = "";//select urls from DB to Array header("Content-Type: text/xml;charset=iso-8859-1"); $this->load->view("sitemap",$data); } } views/sitemap.php <?= '<?xml version="1.0" encoding="UTF-8" ?>' ?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0

In robots.txt can I write the following relative URL for the sitemap file? sitemap: /sitemap.ashx Or do I have to use the complete (absolute) URL for the sitemap file, like: sitemap: http://subdomain.domain.com/sitemap.ashx Why I wonder: I own a new blog service, www.domain.com, that allow users to blog on accountname.domain.com. I use wildcards, so all subdomains (accounts) point to: "blog.domain.com". In blog.domain.com I put the robots.txt to let search engines find the sitemap. But, due to the wildcards, all user account share the same robots.txt file.Thats why I can't use the second

Is there an easy way to create a sitemaps file for Rails projects? Especially for dynamic sites (such as Stack Overflow for example) there should be a way to dynamically create a sitemaps file. What is the way to go in Ruby and/or Rails? What would you suggest? Is there any good gem out there? Add this route towards the bottom of your config/routes.rb file (more specific routes should be listed above it): map.sitemap '/sitemap.xml', :controller => 'sitemap' Create the SitemapController (app/controllers/sitemap_controller): class SitemapController < ApplicationController layout nil def index