By default, every single page in your site will be indexed by search engine spiders. To control this default action, just use meta tags!
How? Your meta tags must be located in the HTML codes of your pages, in the header between the <head> and </head> tags.
So if you want spiders to index your page and follow every link on it, insert:
<meta name="robots" content="index, follow">
For no indexing but following of links, use:
<meta name="robots" content="noindex, follow">
So more combinations are possible, example:
<meta name="robots" content="index, nofollow">
and:
<meta name="robots" content="noindex, nofollow">
Let's say you don't want your pages to be indexed but want spiders to follow links on it, your HTML should starts like this:
<html>
<head>
<title>Page title</title>
<meta name="robots" content="noindex, follow">
</head>
<body>body contents</body>
</html>
That's it! Spiders will always check for such meta tags before deciding waht to do with your pages.
Hope this helps
