Results 1 to 5 of 5
Hybrid View
-
12th Mar 2010, 04:39 PM #1OPMember
-
12th Mar 2010, 06:41 PM #2Member
it tells bots like google or yahoo search engines which pages they can and can't crawl.
Basicaly - if you have some part of website you don't want google to index, then you can add it to this file and google bot won't visit it.
-
12th Mar 2010, 06:49 PM #3Member
like u wont like to index ur admincp or memberlist or modcp...
Then u have to add spmething like this :
/admincp
/modcpI am the TharkiBaba >_> Oh well thats my websites name -_-
-
13th Mar 2010, 03:45 AM #4
-
13th Mar 2010, 04:45 AM #5Member
Welcome brother...
I am the TharkiBaba >_> Oh well thats my websites name -_-
Sponsored Links
Thread Information
Users Browsing this Thread
There are currently 1 users browsing this thread. (0 members and 1 guests)
Similar Threads
-
Robots.txt Help
By mastergun in forum Technical Help Desk SupportReplies: 1Last Post: 5th Sep 2012, 11:56 PM -
robots.txt
By V!P in forum Webmaster DiscussionReplies: 9Last Post: 30th Jun 2012, 11:12 PM -
how to make a robots.txt
By V!P in forum Technical Help Desk SupportReplies: 7Last Post: 25th Jun 2012, 08:00 AM -
Help with robots.txt
By CK13 in forum Webmaster DiscussionReplies: 6Last Post: 7th Jun 2011, 03:33 PM -
Robots.txt
By GoPantheoN in forum Technical Help Desk SupportReplies: 6Last Post: 12th Dec 2009, 10:48 AM
themaCreator - create posts from...
Version 3.08 released. Open older version (or...