Fetch as Googlebot Error?

[jiefangjun]

when I use the google webmaster to Fetch as Googlebot.
It turns out Unreachable page.
But I do have robots.txt under my website root dir
I don't know why?
anyone can help me?
btw My site was down for about 10 days due to the bad webhosting.
Is that the reason?

jiefangjun Reviewed by jiefangjun on 12th Apr 2012. Fetch as Googlebot Error? when I use the google webmaster to Fetch as Googlebot. It turns out Unreachable page. But I do have robots.txt under my website root dir I don't know why? anyone can help me? btw My site was down for about 10 days due to the bad webhosting. Is that the reason? Rating: 5

[Desi_Boy]

may be DNS not updated so that google not crawlling

[hihotfile]

off topic :
man Desi_Boy i found your secret you join jan 2012 and posts like above crap to increase post count clever tip...... i think mod should act on this kid

[msk19994]

In webmastools when u click fetch it checks instantly there must be something wrong with the file are u sure u have allow permisions in the robot.txt ?
or is the robots.txt in the correct location ?

[jiefangjun]

In webmastools when u click fetch it checks instantly there must be something wrong with the file are u sure u have allow permisions in the robot.txt ?
or is the robots.txt in the correct location ?

I think it's robots.txt not robot.txt
Yes I do have it in public_html dir cos I m using shared webhosting

[msk19994]

Sorry my bad
btw can u link the robots.txt ?
so that we can see whats the problem

[Desi_Boy]

http://just-ping.com/ check here pinging in all countries?

[jiefangjun]

This is my robots : http://fetishjav.com/robots.txt

[msk19994]

who places a sitemap in robots.txt ???
u submit the sitemap to google directly

and it should be like

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Allow: /

[Ashleyuk1984]

Mine says this:



However:



It appears to still be finding it because it downloaded it 49 minutes ago.
Seems to be working for me.
I don't know if this is the same issues as your having or not ?

But I can definitely access

www.kengyea.com/robots.txt

edit: Ahh.. I was to slow with my comment, I see your correct URL above