white paper Google robots.txt defends itself on Halloween

No Commentsin News31st Oct 2009by Peter

Google has decided to add 3 lines into their robots.txt this Halloween

Disallow: /app/updates

User-agent: Kids
Disallow: /tricks
Allow: /treats

Sitemap: http://www.gstatic.com/s2/sitemaps/profiles-sitemap.xml

Question is, will they be safe? Or will someone be able to egg/teepee the google homepage?

latest blog posts in news

Launch of the all new Back2 ecommerce website

We are proud to announce the most recent launch of the long established central London based ergonomic furniture company Back2. ...

Google robots.txt defends itself on Halloween

Google has decided to add 3 lines into their robots.txt this Halloween ...

Pro-bono work for local charity

Our London based web design and development team at Active Webdezign ltd. have been working hard on a charity website ...

team building day at the Go-Kart track

The summer has once again finaly arrived without any sign of a heatwave, but that can be expected in the ...

white paper read and write comments

No Comments »

RSS feed for comments on this post. TrackBack URL

Leave a comment

No comments yet.