Part of Jaimie Sirovich's adventure in SEO, Google
Archived; click post to view.
Excerpt: Some people may know about this already, but it's worth discussing since it has been pertinent to me a few times:In theory, according to my interpretation of the robots.txt specification, if a Disallow: under User-agent: "*" exists, as well a Disallow: under a specific robot's User ...
Part of Jaimie Sirovich's adventure in SEO, Google
Archived; click post to view.
Excerpt: The following is a quote straight from Google's Investor Relations web page. "If an opportunity arises to take advantage of competitors' confidential information, remember: don't be evil. We compete, but we don't cheat." Unfortunately, I'm not so sure this speaks for ...