[Git][qa/jenkins.debian.net][master] prepare some parts of arm64.r.d.n and disable some arm64 CI workers
Holger Levsen (@holger)
gitlab at salsa.debian.org
Tue Jan 21 19:30:39 GMT 2025
Holger Levsen pushed to branch master at Debian QA / jenkins.debian.net
Commits:
89f472e3 by Holger Levsen at 2025-01-21T20:30:14+01:00
prepare some parts of arm64.r.d.n and disable some arm64 CI workers
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
7 changed files:
- bin/reproducible_build_workers
- hosts/osuosl5-amd64/etc/dehydrated/domains.txt
- hosts/osuosl5-amd64/etc/nginx/nginx.conf
- + hosts/osuosl5-amd64/opt/etc/rebuilderd-arm64.conf
- + hosts/osuosl5-amd64/opt/etc/rebuilderd-sync-arm64.conf
- hosts/osuosl5-amd64/var/www/html/rebuilderd-setup.html
- job-cfg/reproducible.yaml
Changes:
=====================================
bin/reproducible_build_workers
=====================================
@@ -60,30 +60,18 @@ i386_11 ionos6-i386 ionos12-i386
i386_12 ionos12-i386 ionos16-i386
# arm64
-arm64_1 codethink01-arm64 codethink02-arm64
-arm64_2 codethink01-arm64 codethink03-arm64
-arm64_3 codethink01-arm64 codethink04-arm64
-arm64_4 codethink02-arm64 codethink01-arm64
-arm64_5 codethink03-arm64 codethink01-arm64
-arm64_6 codethink04-arm64 codethink01-arm64
-arm64_7 codethink02-arm64 codethink03-arm64
-arm64_8 codethink02-arm64 codethink04-arm64
-arm64_9 codethink03-arm64 codethink02-arm64
-arm64_10 codethink04-arm64 codethink02-arm64
-arm64_11 codethink03-arm64 codethink04-arm64
+arm64_1 codethink03-arm64 codethink04-arm64
+arm64_2 codethink03-arm64 codethink04-arm64
+arm64_3 codethink03-arm64 codethink04-arm64
+arm64_4 codethink03-arm64 codethink04-arm64
+arm64_5 codethink03-arm64 codethink04-arm64
+arm64_6 codethink03-arm64 codethink04-arm64
+arm64_7 codethink04-arm64 codethink03-arm64
+arm64_8 codethink04-arm64 codethink03-arm64
+arm64_9 codethink04-arm64 codethink03-arm64
+arm64_10 codethink04-arm64 codethink03-arm64
+arm64_11 codethink04-arm64 codethink03-arm64
arm64_12 codethink04-arm64 codethink03-arm64
-arm64_13 codethink01-arm64 codethink02-arm64
-arm64_14 codethink01-arm64 codethink03-arm64
-arm64_15 codethink01-arm64 codethink04-arm64
-arm64_16 codethink02-arm64 codethink01-arm64
-arm64_17 codethink03-arm64 codethink01-arm64
-arm64_18 codethink04-arm64 codethink01-arm64
-arm64_19 codethink02-arm64 codethink03-arm64
-arm64_20 codethink02-arm64 codethink04-arm64
-arm64_21 codethink03-arm64 codethink02-arm64
-arm64_22 codethink04-arm64 codethink02-arm64
-arm64_23 codethink03-arm64 codethink04-arm64
-arm64_24 codethink04-arm64 codethink03-arm64
# to choose new armhf jobs:
=====================================
hosts/osuosl5-amd64/etc/dehydrated/domains.txt
=====================================
@@ -1,3 +1,5 @@
reproduce.debian.net
amd64.reproduce.debian.net
i386.reproduce.debian.net
+arm64.reproduce.debian.net
+armhf.reproduce.debian.net
=====================================
hosts/osuosl5-amd64/etc/nginx/nginx.conf
=====================================
@@ -141,6 +141,8 @@ http {
server_name reproduce.debian.net;
server_name amd64.reproduce.debian.net;
server_name i386.reproduce.debian.net;
+ server_name arm64.reproduce.debian.net;
+ server_name armhf.reproduce.debian.net;
location /.well-known/acme-challenge/ {
alias /var/lib/dehydrated/acme-challenges/;
=====================================
hosts/osuosl5-amd64/opt/etc/rebuilderd-arm64.conf
=====================================
@@ -0,0 +1,40 @@
+## Configuration for http daemon
+#[http]
+## The address to bind to. This is 127.0.0.1:8484 by default.
+bind_addr = "127.0.0.1:8486"
+## If you use a reverse proxy, use this header instead of the actual connecting ip.
+## Make sure the reverse proxy has filters in place to prevent spoofing issues.
+#real_ip_header = "X-Real-IP"
+## Set a default endpoint for rebuildctl. This is especially useful for the sync timer.
+#endpoint = "http://127.0.0.1:8484"
+
+## A random cookie for administration is generated at startup and written to /var/lib/rebuilderd/auth-cookie
+## You can set this to a fixed value here. Use `pwgen -1s 32` to generate one.
+## rebuildctl is searching for this cookie in ~/.config/rebuilderd.conf, /etc/rebuilderd.conf and
+## /var/lib/rebuilderd/auth-cookie in that order.
+#[auth]
+#cookie = "INSECURE"
+
+## The auth cookie above is only used for the default endpoint.
+## You can use different endpoints with `rebuildctl -H https://rebuilder.example.com status`,
+## In that case you need to configure a section below if you want to attach a cookie.
+#[endpoints."https://rebuilder.example.com"]
+#cookie = "INSECURE"
+
+## IMPORTANT: in production, make sure either `authorized_workers` or `signup_secret` is configured.
+#[worker]
+## If we have a fixed set of workers we can allow-list the keys here.
+#authorized_workers = ["key1", "key2"]
+## If we want to spawn new workers dynamically we can configure a sign up secret below.
+## Use `pwgen -1s 32` to generate one.
+#signup_secret = "INSECURE"
+
+#[schedule]
+## Configure the delay to automatically retry failed rebuilds in hours. The
+## default is 24h, this base is multiplied with the number of rebuilds, so the
+## first retry would happen after 24h, the second retry would happen 48h after the
+## first retry and the third retry would happen 72h after the second retry. There
+## is no upper limit of retries, if you can't afford frequent retries it's
+## recommended to set this to a high value like 168 (1 week) or higher.
+## Successful rebuilds are not retried.
+#retry_delay_base = 24
=====================================
hosts/osuosl5-amd64/opt/etc/rebuilderd-sync-arm64.conf
=====================================
@@ -0,0 +1,53 @@
+## rebuild all of archlinux core
+[profile."archlinux-core"]
+distro = "archlinux"
+suite = "core"
+architectures = ["x86_64"]
+source = "https://ftp.halifax.rwth-aachen.de/archlinux/$repo/os/$arch"
+
+## rebuild community packages of specific maintainers, or allow-list packages by name.
+## If no filter is set, all packages are imported, if both filters are set the package only
+## has to match one of them to be included.
+#[profile."archlinux-community"]
+#distro = "archlinux"
+#suite = "community"
+#architectures = ["x86_64"]
+#source = "https://ftp.halifax.rwth-aachen.de/archlinux/$repo/os/$arch"
+#maintainers = ["somebody"]
+#pkgs = ["some-pkg", "python-*"]
+#excludes = ["tensorflow*"]
+
+[profile."debian-main"]
+distro = "debian"
+suite = "main"
+architectures = ["arm64"]
+#releases = ["buster", "sid"]
+releases = ["trixie"]
+source = "http://deb.debian.org/debian"
+
+[profile."debian-anarchism"]
+distro = "debian"
+suite = "main"
+architectures = ["amd64"]
+releases = ["sid"]
+pkgs = ["anarchism"]
+source = "http://deb.debian.org/debian"
+
+# a set of packages to test certain edge-cases
+[profile."debian-misc"]
+distro = "debian"
+suite = "main"
+architectures = ["amd64"]
+releases = ["sid"]
+pkgs = ["anarchism", "binutils-arm-none-eabi", "libglib2.0-bin", "libglib2.0-dev", "sniffglue", "librust-sniffglue-dev", "dfrs", "librust-dfrs-dev"]
+source = "http://deb.debian.org/debian"
+
+[profile."tails"]
+distro = "tails"
+suite = "stable"
+source = "https://mirrors.wikimedia.org/tails/"
+
+[profile."tails-alpha"]
+distro = "tails"
+suite = "alpha"
+source = "https://mirrors.wikimedia.org/tails/"
=====================================
hosts/osuosl5-amd64/var/www/html/rebuilderd-setup.html
=====================================
@@ -105,6 +105,7 @@ while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie
#
# while true ; do /opt/usr/bin/rebuildctl pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | /opt/usr/bin/rebuildctl pkgs sync-stdin debian main ; echo sleeping 3h now ; sleep 3h ; done
#
+
# until https://github.com/kpcyrd/rebuilderd/issues/152 has been fixed,
# it's also useful to randomize the queue initially once, run as $USER:
echo "update queue set priority = ABS(RANDOM()) % 10000;" |sqlite3 ~/rebuilderd.db
@@ -131,9 +132,11 @@ sed -i "s#reproduce.debian.net#$REBUILDERD_HOSTNAME#g" index.html
</pre>
# it gets messy, how to run more archs on one machine:
-cd ; mkdir -p i386 ; cd i386 ; /opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd-i386.conf
cd ; mkdir -p amd64 ; cd adm64 ; /opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd-amd64.conf
+while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8484 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-amd64.conf debian-main ; echo sleeping 3h now ; sleep 3h ; done
+cd ; mkdir -p i386 ; cd i386 ; /opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd-i386.conf
+while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8485 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-i386.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8485 pkgs sync-stdin debian main ; echo sleeping 3h now ; sleep 3h ; done
</body>
=====================================
job-cfg/reproducible.yaml
=====================================
@@ -436,8 +436,6 @@
- 'ionos12': { my_arch: 'i386' }
- 'ionos15': { my_arch: 'amd64' }
- 'ionos16': { my_arch: 'i386' }
- - 'codethink01': { my_arch: 'arm64' }
- - 'codethink02': { my_arch: 'arm64' }
- 'codethink03': { my_arch: 'arm64' }
- 'codethink04': { my_arch: 'arm64' }
- 'infom01': { my_arch: 'amd64' }
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/commit/89f472e340c3d5ed902cfefb647c6927059582ca
--
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/commit/89f472e340c3d5ed902cfefb647c6927059582ca
You're receiving this email because of your account on salsa.debian.org.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20250121/73bc2c40/attachment-0001.htm>
More information about the Qa-jenkins-scm
mailing list