Required entries in robots.txt

[N.TESLA]

Hello everyone. Brand new to 3dc, so your experienced help is greatly appreciated!

I have just begun the process of migrating an existing site to 3dc and I would like to know which directories and pages need to be in the robots.txt file to prevent any and all occurrences of bogus entries being indexed, such as email a friend, cart pages, and any other pages that can be "visitor generated", or that may otherwise generate duplicate content.

NT

[GonzaloGil]

This is already in place for you, and a second version of the robots.txt is made to block any type of indexing of the https section of your store. Feel free to download the robots.txt (or view it via http://www.yourstore.com/robots.txt) and make changes, however we suggest you leave the entries we created.

[N.TESLA]

Thanks for the quick response!

I looked at another stores two robots files GonzaloGil because we're still on the 3dcart temporary url.

Here are the contents:

User-agent: *
Disallow: /checkout.asp
Disallow: /add_cart.asp
Disallow: /view_cart.asp
Disallow: /error.asp
Disallow: /shipquote.asp
Disallow: /rssfeed.asp
Disallow: /mobile/

Now (also taking the ssl robots file into consideration) do these disallows include the "emailafriend" type of pages?

Thanks,
NT

btw - for what it's worth, so far, I am really impressed with the admin interface. We're moving from another cart/host and for the most part, it has been an easy and short learning curve. Very intuitive.