ryans213

Thanks again JIm. I changed things back to the original version. Its on odd situation as I did compare notes with a robots.txt generator when I created this file. I also have my sitemap verified in Google's webmaster tools. Looks like its back to the drawing board as to what is causing this kind of problem. I appreciate you taking the time to look into it.

Thank you both for your feedback. Jim your attention to details showcases your experience here as the solution is almost always in the details. Unfortunately the robot.txt was my error and the file is actually robots.txt. My file allows robots. After reading your your post I checked my file. The one thing I just tried to alter was spacing as the rest of the details seem to be inline with your feedback. I'm not sure how important things are here with this but I had spaces after the :'s. User-agent: * Disallow: /cgi-bin/ Changed now to. User-agent:* Disallow:/cgi-bin/ Sitemap:http://www.domain.net/sitemap.xml.gz I'm not sure if this is enough of a change but I'm giving it a try. Thanks again.

Hello. I've recently updated a site in my Google webmaster tools. My problem that I am having is that instead of indexing my site's index file it shows the robot.txt file in the search results. User-agent: * Disallow: /cgi-bin/ Disallow: /_notes/ Disallow: /agrana ... This is an odd issue that I'm not finding any good solutions online for. Has anyone had a similiar issue and what was the steps necessary to resolve the matter? Thank you.