Skip to content
View in the app

A better way to browse. Learn more.

Web Designer Forum

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

Robot text issue

Featured Replies

Hello friends,

 

 

 

I have created xml sitempa and submitted to google web masters now if i create a robot text file

User-agent: *
Disallow:
sitemap: Your URL to Your SiteMap

 

 

 

where shld i keep it and what should be the path?

 

 

 

my xml site map is in a folder namedr xmlsitemap in public_html so my path shld be public_html/xmlsitemap/index.xml

 

 

 

and if i dont upload robot textgoogle spider wont read xml sitemap?

 

 

 

and is it necessary to keep xml sitemap in the root directory?

 

 

 

my robots.txt

 

 

User-agent: *
Disallow:
sitemap:  http://www.webdesigncut.com/xmlsitemap/index.xml

 

 

Don't bother with the robots.txt file unless you have content you don't want indexed.

At the moment, you're Disallow: value is empty which makes the file pointless.

As for the sitemap location, tell google where to find it in Google Webmaster Tools, it doesn't need to be in the root directory.

If you want to put the sitemap location in your robots.txt file, google has the answer

Don't bother with the robots.txt file unless you have content you don't want indexed.

At the moment, you're Disallow: value is empty which makes the file pointless.

As for the sitemap location, tell google where to find it in Google Webmaster Tools, it doesn't need to be in the root directory.

If you want to put the sitemap location in your robots.txt file, google has the answer

 

Call it sitemap.xml and stick it in the root - that's the default location that all search engines will look for it. Of course you can place it elsewhere and point your robots file to that if you want to. I usually do both and then submit to webmaster tools for good measure! Bing has a similar tool that you can join and use to submit your sitemap there too. Can't remember if Yahoo does or not...

Call it sitemap.xml and stick it in the root - that's the default location that all search engines will look for it. Of course you can place it elsewhere and point your robots file to that if you want to. I usually do both and then submit to webmaster tools for good measure! Bing has a similar tool that you can join and use to submit your sitemap there too. Can't remember if Yahoo does or not...

 

Always worth submitting the sitemap.xml to the webmaster tools on each search engine - I've tested a number of times and it does seem to speed up indexing.

  • Jo 90 locked this topic
Guest
This topic is now closed to further replies.

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.