seo

I have urls like these: /products/:product_id/deals/new /products/:product_id/deals/index I'd like to disallow the "deals" folder in my robots.txt file. [Edit] I'd like to disallow this folder for Google, Yahoo and Bing Bots. Does anyone know if these bots support wildcard character and so would support the following rule? Disallow: /products/*/deals Also... Do you have any really good tuto on robots.txt rules? As I didn't manage to find a "really" good one I could use one... And one last question: Is the robots.txt the best way to handle this? Or should I better use the "noindex" meta? Thx

1. 新站的收录较慢 2. 文章质量不高 文章难以阅读 排版乱 内容是别的网站采集来的 很难被收录 3. 网站被降权中 4. 蜘蛛不访问[网站配置] 检查网站是否屏蔽了蜘蛛的爬取[ robots] 有没有做外链 看网站日志 5. 原来很多收录 最近不收录了 排除被惩罚的因素 主要还是外链太少 没有足够外链支撑 4的处理: 网站的关键词布局没问题、内容质量没问题，并且规律性的更新网站内容，同时也有持续在一些高权重平台发布外链，为什么百度蜘蛛就是不收录的的网页？ a。 网站是否有屏蔽了百度蜘蛛的抓取、 　　　　1.查看网站的robots.txt文件 　　　　User-agent:* 　　　　Disallow: / 　　　　===========屏蔽所有搜索引擎蜘蛛的抓取 　　　　User-agent: Baiduspider 　　　　Disallow: / 　　　　===========屏蔽百度搜索引擎蜘蛛的抓取 　　　　----------------解决办法 　　　　User-agent: * 　　　　Disallow: /wp-admin/ 　　　　Disallow: /wp-content/ 　　　　==============把Disallow: /改成指定的屏蔽目录 　　　　Allow: / 　　　　==============允许访问 　　　　2. 在网站页面代码

I am using ImportXML in a google docs sheet to aqcuire data from the sistrix api. It works fine but I encountered the limitation of 50 ImportXML commands in one sheet. So I used a script that writes the ImportXML command to a cell (temporary) formula and takes back the resulting value of the cell and copies it to the destination cell. So you can do as much ImportXML queries as you need, as they only appear in one temporary cell in the sheet. The problem here is, that the ImportXML query SOMETIMES takes very long or returns with N/A. Is it possible that my script sometimes doesnt wait for the

I get this error from the Google RichSnippets testing tool : Error: Page contains property "query-input" which is not part of the schema. But where did I make a mistake? HTML : <div id="dkAjaxSearch"> <input id="ajaxSearch" type="text" value="" name="search_term" itemprop="query-input"> Press Enter to search </div> JSON-LD : <script type="application/ld+json"> { "@context": "http://schema.org", "@type": "WebSite", "url": "https://domain.com/", "potentialAction": { "@type": "SearchAction", "target": "http://domain.com/search/{search_term_string}", "query-input": "required name=search_term

I've a web site that generates kml files. An uri like this: /tokml?gid=2846 Generates a file like this: Mt. Dana Summit Trail.kml Using Header('Content-Disposition: inline; filename="Mt. Dana Summit Trail.kml"'); in a PHP script and running on Apache http server. But a Google search on filetype:kml will not give any results from my web site. I could cache all kml files and build an uri like this: /kml/Mt. Dana Summit Trail.kml But are there any other solutions? From my experience, Google usually index URLs with an identifier in the query string quite well - thus, it seems strange that nothing