PDA

View Full Version : robots.txt file help


spazzer
10-16-2010, 11:57 AM
Hi,
If I upload a robots.txt file should it have this in the content to allow all robots

User-agent: *
Allow:

Or can anyone tell me what I should have in this file please

Many Thanks,
Nick C :|

Corrosive
10-16-2010, 12:28 PM
If you are allowing all robots then why have a file at all?

gentleone
10-16-2010, 01:34 PM
If there is no robots.txt file on your server then it is already by default User-agent: * Allow:

spazzer
10-16-2010, 02:50 PM
Thanks for replies guys that's what I needed to know thanks