A simple example

Discuss about top search engine gogole its optimization techniques including the infamous Google Dance, Google News, Google Page Rank, Google Toolbar. Get a top ranking in Google and see your site traffic soar. Discussion related to the Google search engine only please.

Moderator: John55

A simple example

Postby rajiv123 » Sun Feb 07, 2010 7:48 am

The User-Agent line specifies that the next section is a set of instructions just for the Googlebot. All the major search engines read and obey the instructions you put in robots.txt, and you can specify different rules for different search engines if you want to. The Disallow line tells Googlebot not to access files in the logs sub-directory of your site. The contents of the pages you put into the logs directory will not show up in Google search results.
rajiv123
 
Posts: 36
Joined: Sun Jan 17, 2010 2:19 pm

Return to Google

Who is online

Users browsing this forum: No registered users and 6 guests

cron