Skip to content
View in the app

A better way to browse. Learn more.

Web Designer Forum

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

issue with robots.txt

Featured Replies

Hello all,

 

I have created robots.txt for my site.earlier it was working properly.Robot was followed the rules written on robots.txt.

 

But since last few days suddenly i faced issue regarding web robots visits pages that i have disallowed earlier in robots.txt and send me spam mail.

 

Please help me, why this happens?

Hello all,

 

I have created robots.txt for my site.earlier it was working properly.Robot was followed the rules written on robots.txt.

 

But since last few days suddenly i faced issue regarding web robots visits pages that i have disallowed earlier in robots.txt and send me spam mail.

 

Please help me, why this happens?

 

Because robots.txt is an optional guideline that only well-behaved robots (like Googlebot) follow. Spam bots don't care about your rules, they're out to harvest as many email addresses as they can.

Create an account or sign in to comment

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.