Zack Live
23rd July 2008 |

How to Write WordPress robots.txt for SEO

What is a robots.txt? Here is the answer from Google: A robots.txt file provides restrictions to search engine robots (known as “bots”) that crawl the web. These bots are automated, and before they access pages of a site, they check to see if a robots.txt file exists that prevents them from accessing certain pages. Do [...]

more