February 13, 201016 yr Hi All i am just collecting information about how people are finding a web site, i receive an email instantly some one visits the site telling me what they googeld $keywords=$_SERVER['HTTP_REFERER']; is what i am using i am receiving emails from $keywords variable as /robots.txt and /favicon.ico does /favicon.ico meen people have added me to their favorites and how is the robots.txt being found does any one have any ideas thank you
February 13, 201016 yr /favicon.ico is the tiny icon some browsers choose to display in the very top left of the window (on the title bar) - it may also be displayed in a favourites list, but most certainly does not indicate you have been added to the favourites. It is downloaded as a matter of course. /robots.txt is used by robot spiders - you can provide them with extra crawling information using this file (do a search for the file for more information). This almost certainly indicates a spider is crawling your site.
Create an account or sign in to comment