On a client project, we wanted to prevent search engines from accessing pages on the site. It needed to be directly linked to from some various sources, public, but not queryable. So we did the reasonable thing. We modified our robots.txt and added our metatags. Unfortunately, this didn't seem to work as we would expect and pages still showed up in Google searches.
This video was recorded from WordCamp 2009 in San Francisco back in 2009. Four years may have passed, but the basics of search engine optimization are still there. I think one of the problems we all face when dealing with SEO is becoming too calculated and analytical instead of trying to be natural - which Google tries to do.
Improve your SEO: Act like a crawler mglaman Sat, 01/26/2013 - 16:14
A market has exploded for building your online presence, the acronym SEO (Search Engine Optimization has quickly become a common place term for marketing strategies. Before a business could attract new customers with an enticing ad in a newspaper or magazine - but now consumers are active and searching for services. There are only a handful of people that could put forth the true secret to SEO success, but I don't think Google or Bing would really appreciate them telling secrets. Now, let's learn how to improve your SEO.Gone are the days of meta keywords tagging your website.