robots.txt

At the moment of writing, I was playing with WordPress core version 2.3.1 but advice below will be suitable for newer versions also. It is sad that it comes not quite ready for the search engines. One of the reasons is missing robots.txt file. Actually if you enter address http://yoursite.com/robots.txt WordPress will show some data from internal configuration, but there is some room for improvement. Read more »

Let’s do it right!

First, create empty robots.txt file on your local computer. And prepare to fill it with the content explained below.