What is the best way to block spam bots via an htaccess file? Is there a catch all code or does the refer traffic have to be listed individually? Currently I have semalt, buttons for websites, and 7makemoneyonline listed - which seems to be working - until I notice another one. Did I miss anything important?

 

Thoughts?

# block visitors referred from semalt.com
RewriteEngine on
RewriteCond %{HTTP_REFERER} semalt\.com [NC]
RewriteRule .* – [F]
# End semalt block

# block referer spam buttons for website
RewriteEngine On
RewriteCond %{HTTP_REFERER} buttons\-for\-website\.com
RewriteRule ^.* - [F,L]
# End buttons for website block

# BLOCK SITE REFERRERS
RewriteEngine on
 RewriteCond %{HTTP_REFERER} 7makemoneyonline\.com [NC]
RewriteRule .* - [F]
# End

The traffic from the above 3 named sites are working. However, traffic from darodar.com is not. Has anyone else had success in blocking traffic from that site?

SetEnvIfNoCase Referer darodar.com spambot=yes
Order allow,deny
Allow from all
Deny from env=spambot

This http://www.blackmoreops.com/2014/12/19/darodar-com-referrer-spam/ says the spam referrers manipulate Google Analytics and never actually visit your site, so blocking them is pointless. Google Analytics offers filtering if you want to mitigate fake site hits.

what about this?

 

 

BrowserMatchNoCase "Baiduspider" bots
BrowserMatchNoCase "HTTrack" bots
BrowserMatchNoCase "Yandex" bots

Order Allow,Deny
Allow from ALL
Deny from env=bots

at one of my site htaccess file was blocking all urls and sitemap... google indexing goes "NIL".. I just upload a blank htaccess file.. the problem solved... is it ok or dangerous... please guide