If you own a website, you’re probably a big fan of improving your search engine rankings.  There are a lot of ways to go about improving your rankings, and as usual JohnTP has you covered.    His latest post is about the importance of using a robots.txt file to avoid penalizing yourself with the search engines.  He includes some examples of how to make one, as provides some examples as well.

This is an SEO technique I was not aware of, but I have since created one and hope to see some good results in the coming weeks.