search-engine

Can search engines index JavaScript generated web pages?

和自甴很熟 提交于 2019-11-26 14:14:52
问题 Can search engines such as Google index JavaScript generated web pages? When you right click and select view source in a page that is generated by JavaScript (e.g using GWT) you do not see the dynamically generated HTML. I suppose that if a search engine also cannot see the generated HTML then there is not much to index, right? 回答1: Your suspicion is correct - JS-generated content cannot be relied on to be visible to search bots. It also can't be seen by anyone with JS turned off - and, last

Marking up a search result list with HTML5 semantics

谁说我不能喝 提交于 2019-11-26 14:12:35
问题 Making a search result list (like in Google) is not very hard, if you just need something that works. Now, however, I want to do it with perfection, using the benefits of HTML5 semantics. The goal is to define the defacto way of marking up a search result list that potentially could be used by any future search engine. For each hit, I want to order them by increasing number display a clickable title show a short summary display additional data like categories, publishing date and file size My

Block all bots/crawlers/spiders for a special directory with htaccess

╄→尐↘猪︶ㄣ 提交于 2019-11-26 06:44:23
问题 I\'m trying to block all bots/crawlers/spiders for a special directory. How can I do that with htaccess ? I searched a little bit and found a solution by blocking based on the user agent: RewriteCond %{HTTP_USER_AGENT} googlebot Now I would need more user agents (for all bots known) and the rule should be only valid for my separate directory. I have already a robots.txt but not all crawlers take a look at it ... Blocking by IP address is not an option. Or are there other solutions? I know the

How do search engines deal with AngularJS applications?

*爱你&永不变心* 提交于 2019-11-25 22:46:46
问题 I see two issues with AngularJS application regarding search engines and SEO: 1) What happens with custom tags? Do search engines ignore the whole content within those tags? i.e. suppose I have <custom> <h1>Hey, this title is important</h1> </custom> would <h1> be indexed despite being inside custom tags? 2) Is there a way to avoid search engines of indexing {{}} binds literally? i.e. <h2>{{title}}</h2> I know I could do something like <h2 ng-bind=\"title\"></h2> but what if I want to