View Single Post
Old January 17th, 2014, 10:10 AM
proneone proneone is offline
Join Date: Jan 2014
Posts: 33

ok here are the results i get when validating the robots.txt

User-agent Access? Reason
* yes no Disallow directive found

This is the default access policy for any robot without a matching User-agent field.
Rule records

1 User-agent: *
2 Disallow: /store/product/buy/

that doesn't look right.. correct?