View Full Version : site statistics showing robots.txt "Not Found"

05-28-2011, 08:20 AM
Hi I have been going through my site statistics and there is a 404 error for a robots.txt file. I am using dreamweaver cs4 and did a find and replace for robots.txt site wide and there is no mention of it anywhere on my site. How can I find where it exists? Statistics indicate it is at root level. Have checked webspace files too.



05-28-2011, 10:27 AM
Search engines always look for a robots.txt file. This is just a standard thing. If you don't use a robots.txt file then indeed it will show as file not found in your statistics.

05-28-2011, 12:49 PM
Thanks for that!