A few days ago I got a warning from Google about my images not being crawled and to add the following to the Robotx.txt:
User-agent: Googlebot
Disallow:
User-agent: Googlebot-image
Disallow:
I added and pages are still not being crawled and the Google Mobile text says the site is being blocked by the Robots.txt -- how long does it take for a new robots.txt to be picked up by Google?
Thanks
User-agent: Googlebot
Disallow:
User-agent: Googlebot-image
Disallow:
I added and pages are still not being crawled and the Google Mobile text says the site is being blocked by the Robots.txt -- how long does it take for a new robots.txt to be picked up by Google?
Thanks
Comment