37 captures
08 Oct 2011 - 12 Dec 2020
About this capture
Google News now crawling with Googlebot
Thursday, August 25, 2011 2:00 PM
Posted by David Smydra, Google News Product Specialist

(Cross-posted on the Webmaster Central Blog)

Google News recently updated our infrastructure to crawl with Google’s primary user-agent, Googlebot. What does this mean? Very little to most publishers. Any news organizations that wish to opt out of Google News can continue to do so: Google News will still respect the robots.txt entry for Googlebot-News, our former user-agent, if it is more restrictive than the robots.txt entry for Googlebot.

Our Help Center provides detailed guidance on using the robots exclusion protocol for Google News, and publishers can contact the Google News Support Team if they have any questions, but we wanted to first clarify the following:
As with any website, from time to time we need to make updates to our infrastructure. At the same time, we want to continue to provide as much control as possible to news web sites. We hope we have answered any questions you might have about this update. If you have additional questions, please check out our Help Center.
Newer Post
Older Post
Google News
Site Feed

Subscribe to receive posts via email
Visit this group
Post Categories
announcements (30)
currently in the news (13)
features (43)
help for publishers (21)
languages and editions (13)
looking backward (7)
More Blogs from Google
Visit our directory for more information about Google blogs.
Recent posts from more Google blogs
Miglioramento della nuova interfaccia di AdSense e disattivazione della versione precedente
AdSense Blog-Italiano
Project WOW
Google App Engine Blog
Google Analytics Webinar: Getting started with Multi-Channel Funnels
Google Analytics Blog
New! Search data reveal that when the sun goes down, the tablets come out
Google Mobile Ads Blog
International success with the Chrome Web Store
Google Code Blog
More From Google
Google News
News Alerts
Web Alerts
We Love Feedback
To discuss this blog please visit the Google News Help Forum

Google Blog is powered by Blogger. Start your own weblog.

Copyright © 2011 Google Inc. All rights reserved.
Privacy Policy | Terms of Service