It has come to my attention that googlebot is not following the parameters set in robots.txt. This is a nasty bug and I have found from both personal and post on other
seo forums that this is confirmed.
You would think that when you place the noindex tag on your page you would not want it indexed by google. Like said on other forums "
Google must keep a copy of that page internally so that they can tell when the content has changed, and so that they know where that page links to, and so that they know the index/noindex status of the page."
I agree with this both ways.
Matt Cutts from google need to get a handle on this.
