white paper Google robots.txt defends itself on Halloween

No Commentsin News31st Oct 2009by Peter

Google has decided to add 3 lines into their robots.txt this Halloween

Disallow: /app/updates

User-agent: Kids
Disallow: /tricks
Allow: /treats

Sitemap: http://www.gstatic.com/s2/sitemaps/profiles-sitemap.xml

Question is, will they be safe? Or will someone be able to egg/teepee the google homepage?

latest blog posts in news

234 Million websites, Dec 2009

Put simply, if you are not online: You are most definetely missing out on potential clients/customers. Here is a video ...

Google looked different this morning

As most of you will know, Google actively A/B tests a multitude of elements and pages at any given ...

YouTube is down

YouTube is down but not out! It seems that even the big players have some technical issues when it comes ...

Launch of the all new Back2 ecommerce website

We are proud to announce the most recent launch of the long established central London based ergonomic furniture company Back2. ...

white paper read and write comments

No Comments »

RSS feed for comments on this post. TrackBack URL

Leave a comment

No comments yet.