You might've noticed that our blog has been recently moved from techzene.com to techzene.org and it took almost 15 days for the transition to complete (re-writing and tags cleanup process). And I took maximum care to not let search engines crawl my web page as it creates duplicate issues.
And here are the ways that I followed to prevent my blog from being indexed
Note: Do remember that indexing is far different from ranking. A site doesn't have to be indexed to be listed or shown up in the SERPs. If you need more clarification on this issue, have a look at Matt Cutt's explanation below.
So using robots.txt file with Disallow: / will not provide the solution. Instead, just use the below two methods to prevent your site from getting indexed by search engines.
- Meta Robots TagYou should place this tag on every page of your website to work. If you're using CMS like wordpress, you can simply place this meta tag below the <head> in the header.php file to replicate it on all the pages across your website.
<meta name="robots" content="noindex,nofollow"/>
But what if you're using a HTML or the other site where you should have to input the tag on each and every web page separately? In such cases, you can use the 2nd option. - X Robots TagTo use this tag, you'll need to place it in the .htaccess file which can be found in your cpanel.
Header set X-Robots-Tag "noindex, nofollow"
That's it! Your site will not be indexed until you removed these tags. This is the proper way of preventing a site from being indexed.
So I would like to suggest you. Why not you create separate a separate post for the entire process of changing the entire domain without loosing the search engine credit. It would helps us very much.
ReplyDeleteSure Ravi.. Will do that ASAP..Thnks for the Idea :)
ReplyDeleteThanks for sharing with as it's really help us to prevent our check out links and log in links from Google Search Index.
ReplyDelete