September 10, 201412 yr Hi, I recently did a google of a domain that I own, and I found out that there are complete analysis of my domain on these and other similar sites: keywordspy domain report ip-adress.com I would like to know how I could prevent my domain from being analyzed? I tried googling a solution but I do not even know how this is called. Thanks a lot!
September 11, 201412 yr I'm not sure you can without blocking all crawlers. For a full list of scrapers look in WMT at sites linking in. To what end do you not want them analysing your site?
September 11, 201412 yr Author I think I don't even want my site to be listed on these sites. On sameid.net, I discovered that all my websites that are linked to the same google analysis account are listed. It is too much information out there. What do you mean by "For a full list of scrapers look in WMT at sites linking in."?
September 11, 201412 yr There are 100's (if not thousands) of domain scaper sites out there so it would be an ongoing process to block them all. Really all they do is scrape publicly available data and collate it all. Even if you did block them the domain info is still accessible if you want to find it...
September 11, 201412 yr What do you mean by "For a full list of scrapers look in WMT at sites linking in."? 'Scrapers' are websites that generate their content through crawling other sites and scraping the information from the html and then storing it on their site. WMT = Google Web Master Tools, where you can check linking in sites etc. It's not just the underhanded who analyse sites, look at Alexa, industry known and yet never actually asked to index and analyse. Edited September 11, 201412 yr by BrowserBugs
Create an account or sign in to comment