April 18, 201115 yr Hello, i have a client who wants there website im making to be fully untraceable by ALL search engines, is there a way to do this? i would have imagined it would have something to do with robots.txt but would this guarentee search engines wont put the site on the search results? he wants the site so nothing atall on his site would ever come up in search results Thanks, Gary
April 18, 201115 yr Hello, i have a client who wants there website im making to be fully untraceable by ALL search engines, is there a way to do this? i would have imagined it would have something to do with robots.txt but would this guarentee search engines wont put the site on the search results? he wants the site so nothing atall on his site would ever come up in search results Thanks, Gary Hi Gary, He should add the noindex meta too his pages AS WELL as robots.txt <meta name="robots" content="noindex"> This is important as his pages may be linked to from other sources in which case google would return the title of the page in the search results.. so to ensure google drops the page completely, use the meta tag. Dave Edited April 18, 201115 yr by daveb
April 19, 201115 yr http://www.seomoz.org/blog/12-ways-to-keep-your-content-hidden-from-the-search-engines
April 20, 201115 yr He should add the noindex meta too his pages AS WELL as robots.txt In addition to it use .info extension in Domain..to make it nofollow..Well i am not too sure about it, Yeah but making it nofollow will work better if he don't want promotion. Edited April 20, 201115 yr by weblink
April 20, 201115 yr The domain name doesn't have any bearing whether google indexes the site or not. But he must use the meta tag to instruct google NOT to index the page whether it was referred to from his own site or any other link on the internet. Rgds
April 20, 201115 yr Yes, robots.txt is sure shot way to instruct search engines to not to crawl your website and not to show any results in SERPs. However to remove existing results, you can get the website deindexed first. Regards, Raj Hello, i have a client who wants there website im making to be fully untraceable by ALL search engines, is there a way to do this? i would have imagined it would have something to do with robots.txt but would this guarentee search engines wont put the site on the search results? he wants the site so nothing atall on his site would ever come up in search results Thanks, Gary
April 20, 201115 yr Robots.txt is not the be all and end all, to be certain, you have to also add the noindex meta tags because even when using robots.txt, its been known for google to show index entries back to the site in the search results, although it won't show any description it will show a link to the page.
April 21, 201115 yr In addition to it use .info extension in Domain..to make it nofollow.. ... pardon me...? :s
April 22, 201115 yr The domain name doesn't have any bearing whether google indexes the site or not. But he must use the meta tag to instruct google NOT to index the page whether it was referred to from his own site or any other link on the internet. If its a fact then thanks for making it clear, actually i wrote so becoz of my free forum, When i made it it was .org and i was getting dofollow links, after some times its, ext. changes automatically to .info..and now they are nofollow..
April 22, 201115 yr If its a fact then thanks for making it clear, actually i wrote so becoz of my free forum, When i made it it was .org and i was getting dofollow links, after some times its, ext. changes automatically to .info..and now they are nofollow.. so how come you're stating these things then asking and yet your website says that your 'specialization' (sic) is Search Engine Optimization (sic again)?? Seems like false advertising to me.
April 22, 201115 yr Not really. It's all down to your niche. I've literally just finishing blocking Google from displaying anything relating to a child agency section of a site I was working on. which doesn't explain anything. it's still weird.
April 22, 201115 yr which doesn't explain anything. it's still weird. I don't think it's weird at all, what he's simply stating is there are certain times when dealing with sensitive information that you don't want to be locatable on google. Yes there maybe undesirable users who already know the web address and can still reach the information you publish on site which can't be helped unless you implement some kind of security on site, but you can certainly cut down on undesirables by restricting the site from the search engines.
April 22, 201115 yr Author Thanks for the help people will see how it goes and it is slightly odd him wanting it not to appear on google but hes given me a sufficient reason lol
April 25, 201115 yr If u create a site and put the relevant details in it. Surely the search engines crawl the site, even if you did no SEO for the site. robots.txt plays the key role for that. So if u dont want ur site to be crawled, u put disallow * in robots.txt file. If u put like that, it wont allow the search engines to crawl.
April 25, 201115 yr Aaaaaaaaand relax :-) Sometimes I weep at some of the replies given in this forum @weblink - that's some of the most incorrect and stupid advice I've heard. The domain extension has nothinhg to do with if Google indexes it. Why the hell are you saying on your site that you offer seo and marketing services? @OP: totally ignore what weblink said, it's kjust plain incorrect.In response to your question, use robots.txt to block google bot and the google image bot, aswell as adding the nofollow, noindex meta tag to all of your webpages. To speed things up, you could temporarily set a 404 HTTP header until the site has been fully removed from Google (I've personally found this speeds things up).
April 25, 201115 yr snipage Quite right mate, Before I became a full time web designer I worked for 12 years as a London based youth worker and ran several voluntary children's charities. Guidelines around anything to do with children are stringent, especially after the horrible Baby P scandal and removal of information and/or pictures from public accessibility via websites was VERY important.
April 26, 201115 yr Hi, I've found the best way is to use put disallow * in robots.txt file. If the site is already indexed, then you'll have to go to each of the search engines and request that it's removed.
Create an account or sign in to comment