I think better … I think better maintain that way, Matt. As many bloggers can ‘ferry’ that anchor texts like what you said. Especially, your example for NISSAN. Many small entrepreneurs (vendors) related to the industry able to get benefits from it. Like mine, Nissan Impul.
Cool, that explains … Cool, that explains a lot, including what happened with those Google local listings that appeared to have been crawled that were robots.txt’d
This was actually … This was actually pretty interesting. I didn’t know that the meta tag “noindex” would actually totally dump it from the index. Very cool.
Matt Cutts explains why a page that is disallowed in robots.txt may still appear in Google’s search results.
February 25th, 2010 at 1:30 pm
that tip is so good …
that tip is so good for me.. thanx matt!..
February 25th, 2010 at 1:31 pm
I think better …
I think better maintain that way, Matt. As many bloggers can ‘ferry’ that anchor texts like what you said. Especially, your example for NISSAN. Many small entrepreneurs (vendors) related to the industry able to get benefits from it. Like mine, Nissan Impul.
February 25th, 2010 at 1:31 pm
Just make sure you …
Just make sure you remove the rule from robots.txt first or Google will never see the noindex meta tag on the page.
February 25th, 2010 at 1:31 pm
Cool, that explains …
Cool, that explains a lot, including what happened with those Google local listings that appeared to have been crawled that were robots.txt’d
February 25th, 2010 at 1:31 pm
This was actually …
This was actually pretty interesting. I didn’t know that the meta tag “noindex” would actually totally dump it from the index. Very cool.
February 25th, 2010 at 1:31 pm
Wow, I never knew …
Wow, I never knew that! I though robots.txt actually blocked Google from listing the site.
February 25th, 2010 at 1:31 pm
Very useful …
Very useful information. Thanks Matt.