Robot.txt not found and Error

[yaseenwarez]

hi KWWHucntion members. please help me..

in my cpanel root directory i cant find robot.txt file and show Error on google webmaster report Crawl Error.

the report i attached with this thread for review.. please guide me how can i get robot.txt file and how can fix it..




PLEASE HELP ME

yaseenwarez Reviewed by yaseenwarez on 21st Oct 2009. Robot.txt not found and Error hi KWWHucntion members. please help me.. in my cpanel root directory i cant find robot.txt file and show Error on google webmaster report Crawl Error. the report i attached with this thread for review.. please guide me how can i get robot.txt file and how can fix it.. http://www.besthostingforums.com/images/cdn/besthostingforums.com/2009/10/2me1hdx-1.jpg PLEASE HELP ME Rating: 5

[treerow]

isn't it supposed to be "robots.txt" not "robot.txt"

[K3V]

If your forum is in /forum dir copy this into notepad, save as robots.txt & upload to main dir, If your forum is in main dir, remove /forum/ from the list ...

User-agent: *
Disallow: /forum/admincp/
Disallow: /forum/announcement.php
Disallow: /forum/calendar.php
Disallow: /forum/cron.php
Disallow: /forum/editpost.php
Disallow: /forum/faq.php
Disallow: /forum/joinrequests.php
Disallow: /forum/login.php
Disallow: /forum/member.php
Disallow: /forum/misc.php
Disallow: /forum/modcp/
Disallow: /forum/moderator.php
Disallow: /forum/newreply.php
Disallow: /forum/newthread.php
Disallow: /forum/online.php
Disallow: /forum/printthread.php
Disallow: /forum/private.php
Disallow: /forum/profile.php
Disallow: /forum/register.php
Disallow: /forum/search.php
Disallow: /forum/sendmessage.php
Disallow: /forum/showgroups.php
Disallow: /forum/showpost.php
Disallow: /forum/subscription.php
Disallow: /forum/subscriptions.php
Disallow: /forum/threadrate.php
Disallow: /forum/usercp.php

[yaseenwarez]

hi.. now i make new robots.txt file in main root folder and add these below text.

User-agent: *
Disallow: admincp/
Disallow: announcement.php
Disallow: calendar.php
Disallow: cron.php
Disallow: editpost.php
Disallow: faq.php
Disallow: joinrequests.php
Disallow: login.php
Disallow: member.php
Disallow: misc.php
Disallow: modcp/
Disallow: moderator.php
Disallow: newreply.php
Disallow: newthread.php
Disallow: online.php
Disallow: printthread.php
Disallow: private.php
Disallow: profile.php
Disallow: register.php
Disallow: search.php
Disallow: sendmessage.php
Disallow: showgroups.php
Disallow: showpost.php
Disallow: subscription.php
Disallow: subscriptions.php
Disallow: threadrate.php
Disallow: usercp.php



thats all or further need more fix...?


Thanks for guide me ..

[K3V]

User-agent: *
Disallow: /admincp/
Disallow: /announcement.php
Disallow: /calendar.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /faq.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /member.php
Disallow: /misc.php
Disallow: /modcp/
Disallow: /moderator.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /showpost.php
Disallow: /subscription.php
Disallow: /subscriptions.php
Disallow: /threadrate.php
Disallow: /usercp.php

Taken from ... http://www.theadminzone.com/forums/s...ad.php?t=19872

[yaseenwarez]

yeah i put put above text.. with /

that sit .. or need more fix...?

[K3V]

Test it @ www.yoursite.com/robots.txt,
If it shows up its fine

[yaseenwarez]

yeah now its showing like this .. http://www.yaseenwarez.com/robots.txt


Thank you K3V and all members of KWWHucntion