[Qa-jenkins-scm] [Git][qa/jenkins.debian.net][master] block some bad bots

[Holger Levsen]

Holger Levsen pushed to branch master at Debian QA / jenkins.debian.net


Commits:
6216ab79 by Holger Levsen at 2018-10-30T14:56:20Z
block some bad bots

Signed-off-by: Holger Levsen <holger at layer-acht.org>

- - - - -


1 changed file:

- hosts/jenkins/etc/apache2/sites-available/jenkins.debian.net.conf


Changes:

=====================================
hosts/jenkins/etc/apache2/sites-available/jenkins.debian.net.conf
=====================================
@@ -19,6 +19,22 @@
 	ServerName $name
 	ServerAdmin holger at layer-acht.org
 
+	#block bad bots with a 403
+	SetEnvIfNoCase User-Agent "facebookexternalhit" bad_bot
+	SetEnvIfNoCase User-Agent "Twitterbot" bad_bot
+	SetEnvIfNoCase User-Agent "Baiduspider" bad_bot
+	SetEnvIfNoCase User-Agent "MetaURI" bad_bot
+	SetEnvIfNoCase User-Agent "mediawords" bad_bot
+	SetEnvIfNoCase User-Agent "FlipboardProxy" bad_bot
+	SetEnvIfNoCase User-Agent "SemrushBot" bad_bot
+	SetEnvIfNoCase User-Agent "Sogou web spider" bad_bot
+	<Limit GET POST HEAD>
+	  Order Allow,Deny
+	  Allow from all
+	  Deny from env=bad_bot
+	</Limit>
+	#end block bad bots
+
 	<Directory />
 		Options FollowSymLinks
 		AllowOverride None



View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/commit/6216ab79647c207325569d16c977b268e00a5b60

-- 
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/commit/6216ab79647c207325569d16c977b268e00a5b60
You're receiving this email because of your account on salsa.debian.org.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20181030/552d4bae/attachment.html>