No announcement yet.

robots.txt and sitemap

  • Filter
  • Time
  • Show
Clear All
new posts

  • robots.txt and sitemap

    Just curious to what others think about this. Should we add a line to our robots.txt file that will help search engines index our site? I have read a bit on this but I am not completely sure wether to implement or not!

    I know that our xml sitemap is re-created every 15 days with 3DCart and we can also manually re-create it at anytime if we want to. How important is the sitemap to search engines?

    All that being said, if I add:
    Sitemap: to my robots.txt file
    1) Will it help?
    2) Does it matter where or how I add the line.