googlebot

问题 I have login/signup popups on my site which are in hidden div by default. According to Google SEO and hidden elements googlebot should NOT see it. But Google Webmaster tool says that keywords "email" and "password" are top keywords over the site. Why it is so? Why google bot sees them? Should I worry about relevancy of top keywords at all? 回答1: Yes, Googlebot will see the text since it's in the HTML. However, it will probably know that it is hidden text, and thus may not give it a very high

问题 I use jQuery to retrieve content from the database with a json request. It then replaces a wildcard in the HTML (like %title%) with the actual content. This works great and this way I can maintain my multi-language texts in a database, but Googlebot only sees the wildcards, not the actual content. I know Googlebot sees pages without javascript, but is there a way to deal with this? Thanks! 回答1: You should give this document at Google a thorough read. It discusses how to enable Googlebot to

问题 I use jQuery to retrieve content from the database with a json request. It then replaces a wildcard in the HTML (like %title%) with the actual content. This works great and this way I can maintain my multi-language texts in a database, but Googlebot only sees the wildcards, not the actual content. I know Googlebot sees pages without javascript, but is there a way to deal with this? Thanks! 回答1: You should give this document at Google a thorough read. It discusses how to enable Googlebot to

问题 For SEO, I have been tasked with adding a rel="nofollow" to all external links*. The simplest and least obtrusive way to add rel="nofollow" to each external link is with some jQuery. I've done this fine but I'm now wondering: Does Google see changes made during jQuery's document load to the DOM (such as this one) or does it only see the original source code? I don't want to discuss why this is a bad idea or not. This is an SEO consultant's decision and I've learnt that unless implementation

问题 We have a page with over 1000 image, we show only 10 on each page, we load them with ajax, when people "see the images", also using datatable. Everything works fine, however in Google webmaster tools, I just got thousands of 404 errors, with pages like this: http://example.com/ajax/%5C%22http:%5C/%5C/example.com%5C/image%5C/1937%5C/image-name%5C%22 Of course if I go to this page, I get a 404 error, because no page like this exists, but I don't understand then why Google fetches URLs like this

问题 For months, our IIS/ColdFusion server has been throwing 404 errors during Google crawler scans. Normally it's easy to track these down but in this case, Google is trying to scan our CFC files. The files do exist, but they are not exposed to the Internet - only to the ColdFusion server. Nevertheless, Google is seeing links to the CFCs somewhere on our site and is trying to follow them. Below is a dump of our CGI structure during one of the 404's. baseCFC is a CF Mapping to D:\Domains\[domain]

问题 Is it possible to fine-tune directives to Google to such an extent that it will ignore part of a page, yet still index the rest? There are a couple of different issues we've come across which would be helped by this, such as: RSS feed/news ticker-type text on a page displaying content from an external source users entering contact phone etc. details who want them visible on the site but would rather they not be google-able I'm aware that both of the above can be addressed via other techniques

问题 i have a classifieds website. On this website i store in the db, each product page that a user visits for history purposes, so he can view the last products he visited. The problem is that when googlebot and others enter my site, the db fills up with thousands of entrys because it sores the thousand product pages Google visit. I tried various functions with $_SERVER['HTTP_USER_AGENT'] to try to find out is the current user is googlebot or not and if it is, not sore the page views in the db so

问题 Here's a code below which sends an email whenver any page is crawled by google and its resulting in spamming of mailbox. so is it possible to just record last crawled timestamp in a text file on server, which i can read later anytime using perl LWP mod. file should have just this data: 29,jan 2012 GMT etc If bot is visiting my site multiple times then it should overwrite txt file and record the last visit time only, please help with some implementation if possible <?php if ( strpos( $_SERVER[

问题 Closed. This question is off-topic. It is not currently accepting answers. Want to improve this question? Update the question so it's on-topic for Stack Overflow. Closed 7 years ago . I have a site with the following robots.txt in the root: User-agent: * Disabled: / User-agent: Googlebot Disabled: / User-agent: Googlebot-Image Disallow: / And pages within this site are getting scanned by Googlebots all day long. Is there something wrong with my file or with Google? 回答1: It should be Disallow: