PDA

View Full Version : robots


richcodesign
11-16-2009, 10:04 AM
Hello,

I have created a robots file through google and wonder if anyone can confirm that it is going to only block the selected folders (and content in that folder). See code below
The last thing i want is it to block all my site!

-------------------------------------------
User-agent: *
Allow: /

User-agent: Googlebot
Disallow: /colourswatches/
Disallow: /casefiles/
Disallow: /datasheets/
Allow: /
-------------------------------------------

Thanks, look forward to your reply

edbr
11-17-2009, 02:02 AM
looks ok heresa useful online generator http://www.mcanerin.com/en/search-engine/robots-txt.asp

richcodesign
11-17-2009, 07:29 AM
Thanks... very helpful