Index, follow tag

General ShopSite user discussion

Index, follow tag

Postby sdps » Tue Sep 05, 2006 9:50 am

<META NAME="Robots" CONTENT="index,follow">

This tag is generated for new pages. If I do not want to have any robots visiting or indexing, can this be removed via ShopSite?
sdps
 
Posts: 19
Joined: Wed Aug 23, 2006 1:33 pm

Postby loren_d_c » Tue Sep 05, 2006 10:00 am

There is no particular setting to toggle this on or off. This is probably coming from the page template you are using. The way to remove it would be to make a custom template without this code.

Also note that if there is no link to these pages anywhere on the web or on any other pages on your site that are indexed by search engines already, then search engines are not going to index these pages anyway, because they will never know about them.

Also, if you don't want any search engines indexing pages in a certain directory of your web site, you can make a robots.txt file for your site that tells them to stay away from that directory and they will, regardless of the meta tags in the pages in that directory.

-Loren
loren_d_c
 
Posts: 2572
Joined: Fri Aug 04, 2006 12:02 pm
Location: Anywhere


Return to User Forum

Who is online

Users browsing this forum: Bing [Bot] and 96 guests