[Git][qa/jenkins.debian.net][master] buildinfos.d.n: more user-agents restrictions

[Mattia Rizzolo (@mattia)]

Mattia Rizzolo pushed to branch master at Debian QA / jenkins.debian.net


Commits:
1cad7886 by Mattia Rizzolo at 2025-12-17T15:17:54+01:00
buildinfos.d.n: more user-agents restrictions

Signed-off-by: Mattia Rizzolo <mattia at debian.org>

- - - - -


1 changed file:

- hosts/ionos7-amd64/etc/apache2/sites-available/buildinfos.debian.net.conf


Changes:

=====================================
hosts/ionos7-amd64/etc/apache2/sites-available/buildinfos.debian.net.conf
=====================================
@@ -42,38 +42,44 @@
 	SetEnvIf User-Agent "Twitterbot" bad_bot
 	SetEnvIf User-Agent "yacybot" bad_bot
 	SetEnvIf User-Agent "ZoomBot" bad_bot
-	#end block bad bots
+	SetEnvIf User-Agent "Bytespider" bad_bot
+	SetEnvIf User-Agent "Scrapy" bad_bot
+	SetEnvIf User-Agent "Aliyun" bad_bot
+	SetEnvIf User-Agent "ClaudeBot" bad_bot
+	SetEnvIf User-Agent "PetalBot" bad_bot
+
+	# (nowadays) unrealistic User-Agents
+	SetEnvIf User-Agent "^.*Opera/(8|9)\..*$" bad_bot
+	SetEnvIf User-Agent "^.*trident/(3|4|5).*$" bad_bot
+	SetEnvIf User-Agent "^.*Windows\ (95|98|CE|NT\ [02346789]|NT\ 5\.[023456789]).*$" bad_bot
+	SetEnvIf User-Agent "^.*Ipod.*$" bad_bot
+	SetEnvIf User-Agent "^.*Firefox/(3\.8|3\.6\.([0-9]+)).*$" bad_bot
+
 
 	<Directory />
 		Options FollowSymLinks
 		AllowOverride None
-		<Limit GET POST HEAD>
-		  Order Allow,Deny
-		  Allow from all
-		  Deny from env=bad_bot
-		</Limit>
+		Require all denied
 	</Directory>
 	<Directory /var/www/>
 		Options Indexes FollowSymLinks MultiViews
 		AllowOverride None
 		Require all granted
 		AddType text/plain .log
-		<Limit GET POST HEAD>
-		  Order Allow,Deny
-		  Allow from all
-		  Deny from env=bad_bot
-		</Limit>
+		<RequireAll>
+			Require all granted
+			Require not env bad_bot
+		</RequireAll>
 	</Directory>
 	<Directory /var/lib/jenkins/userContent>
 		Options Indexes FollowSymLinks MultiViews
 		AllowOverride None
 		Require all granted
 		AddType text/plain .log
-		<Limit GET POST HEAD>
-		  Order Allow,Deny
-		  Allow from all
-		  Deny from env=bad_bot
-		</Limit>
+		<RequireAll>
+			Require all granted
+			Require not env bad_bot
+		</RequireAll>
 	</Directory>
 
 	<FilesMatch "\.gz$">



View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/commit/1cad7886377612a261b0f4f09db8fb7e167ccdf0

-- 
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/commit/1cad7886377612a261b0f4f09db8fb7e167ccdf0
You're receiving this email because of your account on salsa.debian.org.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20251217/5119db0d/attachment-0001.htm>