[Git][qa/jenkins.debian.net][master] jenkins nodes: cleanup traces of rebuilder-snapshot and snapshot.r-b.o - those...
Holger Levsen (@holger)
gitlab at salsa.debian.org
Tue May 13 18:00:10 BST 2025
Holger Levsen pushed to branch master at Debian QA / jenkins.debian.net
Commits:
453a6d63 by Holger Levsen at 2025-05-13T18:59:26+02:00
jenkins nodes: cleanup traces of rebuilder-snapshot and snapshot.r-b.o - those were good experiements. thanks lynxis and fpierret!
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
8 changed files:
- − README.snapshot.r-b.o
- THANKS.head
- TODO
- TODO.infrastructure
- TODO.r.d.n
- bin/reproducible_html_nodes_info.sh
- − hosts/osuosl5-amd64/etc/systemd/system/rebuilder-snapshot-metadata.service
- − jenkins-nodes-home/authorized_keys.snapshot
Changes:
=====================================
README.snapshot.r-b.o deleted
=====================================
@@ -1,42 +0,0 @@
-About the snapshot.r-b.o setup
-==============================
-:Author: Holger Levsen
-:Authorinitials: holger
-:EMail: holger at layer-acht.org
-:Status: working, in progress
-:lang: en
-:Doctype: article
-:License: GPLv2
-
-== Scope
-
-Describe how snapshot.r-b.o has been set up on a dedicated machine
-hosted at OSUOSL.org
-
-=== initial setup
-
-snapshot.r-b.o is osuosl4-amd64.debian.net, to be moved to
-osuosl5-amd64.debian.net.
-
-I followed https://github.com/fepitre/debian-snapshot#installation and
-added the needed packages to update_jdn.sh in this git repo.
-
-https://github.com/fepitre/debian-snapshot was cloned into ~jenkins/debian-snapshot/
-
-sudo cp ~jenkins/debian-snapshot/api/snapshot-api.service /usr/lib/systemd/system
-and adopted two lines:
- User=jenkins
- WorkingDirectory=/var/lib/jenkins/debian-snapshot/api
-
-sudo systemctl daemon-reload
-sudo mkdir -p /snapshot /var/run/snapshot /var/log/snapshot
-sudo chown jenkins:www-data /var/run/snapshot
-sudo chown postgres:postgres /var/lib/postgresql
-sudo chown jenkins:jenkins /var/log/snapshot
-
-nginx.conf from ~jenkins/debian-snapshot/api/nginx.conf has been copied into this
-git repo so we can maintain our copy here.
-
-
-
-// vim: set filetype=asciidoc:
=====================================
THANKS.head
=====================================
@@ -44,8 +44,8 @@ link:https://jenkins.debian.net/["jenkins.debian.net"] would not be possible wit
** 16 cores with 128 GB memory for osuosl1-amd64.reproducible.osuosl.org used for building OpenWrt, coreboot and NetBSD for t.r-b.o
** 16 cores with 128 GB memory for osuosl2-amd64.reproducible.osuosl.org used for building OpenWrt, coreboot for t.r-b.o
** 16 cores with 128 GB memory for osuosl3-amd64.reproducible.osuosl.org used for building Debian live, Debian bootstrapping jobs, Debian janitor jobs, mmdebstrap-jenkins jobs and openqa.d.n workers
- ** 24 cores with 64 GB memory for osuosl4-amd64.reproducible.osuosl.org plus 16TB RAID on HDDs for developing https://rebuilder-snapshot.debian.net and other snapshot and rebuilding related experiments
- ** 16 cores with 64 GB memory for osuosl5-amd64.reproducible.osuosl.org plus 20TB RAID on SDDs for running and developing https://rebuilder-snapshot.debian.net
+ ** 24 cores with 64 GB memory for osuosl4-amd64.reproducible.osuosl.org plus 16TB RAID on HDDs for rebuilderd-worker (was once used for developing https://rebuilder-snapshot.debian.net and other snapshot and rebuilding related experiments)
+ ** 16 cores with 64 GB memory for osuosl5-amd64.reproducible.osuosl.org plus 20TB RAID on SDDs for running https://reproduce.debian.net
==== Past sponsors
=====================================
TODO
=====================================
@@ -22,21 +22,7 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
** add -o pipefail to all at once first. that should have less fallout that -u.
** though -u is also very nice. it will catch typos.
-=== 2024 things
-
-* rebuilderd
-** make install breaks setup
-** start rebuilderd and workers as services
-** also pkg-sync service
-** reinstall with user rebuilderd
-** publish docs
-** purge postgresql from osuosl4 and and 5.
-** add more workers on o4
-** use web frontend from archlinux too? https://gitlab.archlinux.org/archlinux/rebuilderd-website
-*** probably not
-** install on o4 and test trixie there
-*** reuse cache from o5 to ease snapshot bandwidth?
-*** maybe rebuild with nocheck profile there?
+=== 2025 things
* in TODO.trixie:
** s#trixie#forky#g and s#bookworm#trixie#g in there, and check for bullseye, buster and stretch too
=====================================
TODO.infrastructure
=====================================
@@ -47,7 +47,6 @@ make it so that *either* openwrt, coreboot or netbsd is built
split this on several hosts:
osuosl3-amd64: Debian live-builds / Debian bootstrap jobs / debian-janitor / mmdebstrap-jenkins jobs / openqa.d.n workers
FIXME: this needs a plan
-point snapshot.r-b.o to rebuilder-snapshot.d.n?
improve ionos naming scheme so the datacenter becomes visible and whether its running in the future or not?
ionos151 - fkb/5/future
ionos050 - fra/5/today
=====================================
TODO.r.d.n
=====================================
@@ -72,5 +72,4 @@ update README and THANKS
the db is still 80gb after vacuuming and splitting into amd64 and all...
Static content last modified: doesnt work
wishlist: all bad src pkgs on all archs combined :) by maintainer+uploaders :)
-setup one rebuilder-snapshot instance and use that as cache for all workers?
-drop rebuilder-snapshot-metadata.service from o4 and o5
+point http://snapshot.reproducible-builds.org/ to snapshot.debian.org
=====================================
bin/reproducible_html_nodes_info.sh
=====================================
@@ -1,7 +1,7 @@
#!/bin/bash
# vim: set noexpandtab:
-# Copyright © 2015-2024 Holger Levsen <holger at layer-acht.org>
+# Copyright © 2015-2025 Holger Levsen <holger at layer-acht.org>
# © 2018 Mattia Rizzolo <mattia at debian.org>
# released under the GPLv2
@@ -23,8 +23,6 @@ explain_nodes() {
osuosl1) write_page "<br /><small>(r-b Alpine, Coreboot, NetBSD, OpenWrt builds)</small>" ;;
osuosl2) write_page "<br /><small>(r-b Alpine, Coreboot, OpenWrt builds)</small>" ;;
osuosl3) write_page "<br /><small>(r-b Debian live-build / bootstrap jobs and Debian janitor jobs, mmdebstrap-jenkins jobs and openqa.d.n workers</small>" ;;
- osuosl4) write_page "<br /><small>(r-b snapshot development)</small>" ;;
- osuosl5) write_page "<br /><small>(r-b rebuilder-snapshot.debian.net)</small>" ;;
codethink04) write_page "<br /><small>(r-b Debian builds and http(s)-proxy)</small>" ;;
ionos*4) write_page "<br /><small>(r-b http(s)-proxy)</small>" ;;
*) write_page "<br /><small>(r-b Debian builds)</small>" ;;
=====================================
hosts/osuosl5-amd64/etc/systemd/system/rebuilder-snapshot-metadata.service deleted
=====================================
@@ -1,12 +0,0 @@
-[Unit]
-Description=Gunicorn instance to serve rebuilder-snapshot metadata
-After=network.target
-
-[Service]
-User=www-data
-Group=www-data
-WorkingDirectory=/srv/rebuilder-snapshot/metaservice/
-ExecStart=/usr/bin/gunicorn --workers 3 --bind 127.0.0.1:5001 wsgi:app
-
-[Install]
-WantedBy=multi-user.target
=====================================
jenkins-nodes-home/authorized_keys.snapshot deleted
=====================================
@@ -1 +0,0 @@
-ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDrCCkCOLNfrUY71+SEdPVQEBzPcKqaJwde4FRtrkc2xwpKLy+8gitFp8Wp5FYoDx4zmnNYXgpqJtieOeSUi7A1QKWVbXWvB2k41bq7GrYz9H3bMWCQBHx4VGM+RbpBaqV54StD1PPwcy7sxBRAmx9c891wFndKBy+5BDqR+d5QwpJNN7XdJyT0ApzsZgRwNtyoFfFEp5KEWQzXnXOTbWduAdCaPxtMILr4VXY+CXCdl7ZRVA5U1MBieRH4ZSD/Ppmz2dTOtJG7sltYhLXHOa8em61PM8LVN6VOUpWO9IcKZ2Qs8r+8FreIO2VRR9WgLSk4k0C0S8PBq/wxopmL8JQLmi799Gwvdla6k960qJtdsyYcxp8K6FHxnj+yt3YurBtxJwJM7LuxSOtPGh58HukXfiB2z5xiRwr/fcJxoTHpios2r0O2OsPAWC2B3cuhF3p62yJxyzkp4R9vr9TcXW5YF6yQJ/aaAb/tk2eXuoulWL2/U2GL0t6o7izzX29mh/U= fpierret at qubes-os.org
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/commit/453a6d63d81a5d3a64fdca2a4e3557e15582f0e3
--
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/commit/453a6d63d81a5d3a64fdca2a4e3557e15582f0e3
You're receiving this email because of your account on salsa.debian.org.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20250513/9b90a9ad/attachment-0001.htm>
More information about the Qa-jenkins-scm
mailing list