Robots txt file uses

Discuss about top search engine gogole its optimization techniques including the infamous Google Dance, Google News, Google Page Rank, Google Toolbar. Get a top ranking in Google and see your site traffic soar. Discussion related to the Google search engine only please.

Moderator: John55

Robots txt file uses

Postby mattmark » Mon May 31, 2010 4:17 pm

Robots txt file is very usefull to prevent any bot to index your web site, infact each web site should have because i do not think that many crawlers check and index your web site with having robots.txt
mattmark
 
Posts: 8
Joined: Mon Nov 09, 2009 10:12 am

Return to Google

Who is online

Users browsing this forum: No registered users and 4 guests

cron