This seems to be a trend with them. On their front man’s blog not too long ago he pondered/asked for feedback about whether or not their bots should ignore no-index requests and list those pages anyway. Their excuses, sorry their reasons, were to “improve their customer’s searching experience” and my personal favorite “because someone else did it first.”

There are simply so many better things they could be doing to “improve their customer’s searching experience” besides ignoring the wishes of website owners and worrying about some dastardly page hidden behind a form.

What’s next, we’ll only index your site if it doesn’t have password protected areas?

I just wish someone would go talk to their search engine team, smack them with a bit of reality, and tell them to stick with what they know (and usually do quite well) and stop trying to be the Internet police.