[Git][qa/jenkins.debian.net][master] 2 commits: r.d.n.: randomize pkg sync times
Holger Levsen (@holger)
gitlab at salsa.debian.org
Wed Mar 5 12:21:02 GMT 2025
Holger Levsen pushed to branch master at Debian QA / jenkins.debian.net
Commits:
5ec9a13f by Holger Levsen at 2025-03-05T13:03:51+01:00
r.d.n.: randomize pkg sync times
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
f6a87edd by Holger Levsen at 2025-03-05T13:20:53+01:00
r.d.n.: update TODOs
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
4 changed files:
- TODO.r.d.n
- TODO.rebuilderd-systemd-units
- hosts/codethink02-arm64/opt/usr/libexec/rebuilderd/rebuilder-debian.sh
- hosts/osuosl5-amd64/var/www/html/rebuilderd-setup.html
Changes:
=====================================
TODO.r.d.n
=====================================
@@ -1,10 +1,20 @@
RFH running r.d.n
- - shrink the db please, test with https://r.d.n/$arch/stats/db-backup/
- - find a way to reschedule as (any) user
- - i18n-en review of rdn intro text, with cc: to jochen and josch
+ - systemd units for everything, see TODO.rebuilderd-systemd-units
+ - index.html:
+ - should show $arch+all combined stats (MR189)
+ - the worker(s) should be links to thanks.html
+ - thanks.html needs updates
+ - add note: strictly speaking this is not Debian, but r-b and some DDs and other folks...!
+ - then, i18n-en review of rdn intro text, with cc: to jochen and josch
+ - maybe: move workers column "into" suite/arch column, and then, percentage tried/queued sources too :)
+ - $arch/stats+all - statistics including arch:all
- $arch/stats-src - source based view of statistics
- $arch/stats-uploaders - uploaders/maintainers based view of statistics
- - systemd units for everything, see TODO.rebuilderd-systemd-units
+ - /status/$pkg - showing ones package status on all tested archs
+ - rebuilderd puts inputs and outputs in /tmp, should be in of ~/tmp
+ - shrink the db please, test with https://r.d.n/$arch/stats/db-backup/
+ - find a way to reschedule as (any) user
+
file *important* bugs about arch:all issues just needing no source change uploads. justification: i plan to NMU :)
announce this once globally on -devel
=====================================
TODO.rebuilderd-systemd-units
=====================================
@@ -14,7 +14,7 @@ debrebuild cache size limiter unit
use atime if available, else mtime
pkg sync unit
- run every 6h, 2h after dinstall
+ run every 6h +- 30min, 2.5h after dinstall
rebuilderd units
=====================================
hosts/codethink02-arm64/opt/usr/libexec/rebuilderd/rebuilder-debian.sh
=====================================
@@ -27,6 +27,7 @@ apt-get -o Dir=. source -qq --print-uris "$(basename "$1" | cut -d_ -f1)"
apt-get -o Dir=. source -qq --download-only "$(basename "$1" | cut -d_ -f1)"
dcmd sha256sum *.dsc
+echo
echo "+------------------------------------------------------------------------------+"
echo "| Calling debrebuild $(date -u -R) |"
echo "+------------------------------------------------------------------------------+"
=====================================
hosts/osuosl5-amd64/var/www/html/rebuilderd-setup.html
=====================================
@@ -104,10 +104,10 @@ apt-get -o Dir=. source --download-only "$(basename "$1" | cut -d_ -f1)"
/opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd.conf
#
# run this in screen as $USER to update the list of packages frequently
-while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8484 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync.conf debian-main ; echo sleeping 3h now ; sleep 3h ; done
+while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8484 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync.conf debian-main ; ST=$(shuf -i 150-210 -n 1) ; echo sleeping ${ST}m now ; sleep ${ST}m ; done
# for rebuilding arch:any only:
#
-# while true ; do /opt/usr/bin/rebuildctl pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | /opt/usr/bin/rebuildctl pkgs sync-stdin debian main ; echo sleeping 3h now ; sleep 3h ; done
+# while true ; do /opt/usr/bin/rebuildctl pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | /opt/usr/bin/rebuildctl pkgs sync-stdin debian main ; ST=$(shuf -i 150-210 -n 1) ; echo sleeping ${ST}m now ; sleep ${ST}m ; done
#
# until https://github.com/kpcyrd/rebuilderd/issues/152 has been fixed,
@@ -137,23 +137,23 @@ sed -i "s#reproduce.debian.net#$REBUILDERD_HOSTNAME#g" index.html
# it gets messy, how to run more archs on one machine:
cd ; mkdir -p all ; cd all ; /opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd-all.conf
-while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8489 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-all.conf debian-main --print-json | jq '.[] | select(.architecture = "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8489 pkgs sync-stdin debian main ; echo sleeping 3h now ; sleep 3h ; done
+while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8489 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-all.conf debian-main --print-json | jq '.[] | select(.architecture = "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8489 pkgs sync-stdin debian main ; ST=$(shuf -i 150-210 -n 1) ; echo sleeping ${ST}m now ; sleep ${ST}m ; done
# it gets messy, how to run more archs on one machine:
cd ; mkdir -p amd64 ; cd amd64 ; /opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd-amd64.conf
-while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8484 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-amd64.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8484 pkgs sync-stdin debian main ; echo sleeping 3h now ; sleep 3h ; done
+while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8484 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-amd64.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8484 pkgs sync-stdin debian main ; ST=$(shuf -i 150-210 -n 1) ; echo sleeping ${ST}m now ; sleep ${ST}m ; done
cd ; mkdir -p arm64 ; cd arm64 ; /opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd-arm64.conf
-while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8486 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-arm64.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8486 pkgs sync-stdin debian main ; echo sleeping 3h now ; sleep 3h ; done
+while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8486 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-arm64.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8486 pkgs sync-stdin debian main ; ST=$(shuf -i 150-210 -n 1) ; echo sleeping ${ST}m now ; sleep ${ST}m ; done
cd ; mkdir -p armhf ; cd armhf ; /opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd-armhf.conf
-while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8487 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-armhf.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8487 pkgs sync-stdin debian main ; echo sleeping 3h now ; sleep 3h ; done
+while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8487 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-armhf.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8487 pkgs sync-stdin debian main ; ST=$(shuf -i 150-210 -n 1) ; echo sleeping ${ST}m now ; sleep ${ST}m ; done
cd ; mkdir -p i386 ; cd i386 ; /opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd-i386.conf
-while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8485 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-i386.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8485 pkgs sync-stdin debian main ; echo sleeping 3h now ; sleep 3h ; done
+while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8485 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-i386.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8485 pkgs sync-stdin debian main ; ST=$(shuf -i 150-210 -n 1) ; echo sleeping ${ST}m now ; sleep ${ST}m ; done
cd ; mkdir -p riscv64 ; cd riscv64 ; /opt/usr/bin/rebuilderd -c /opt/etc/rebuilderd-riscv64.conf
-while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8488 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-riscv64.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8488 pkgs sync-stdin debian main ; echo sleeping 3h now ; sleep 3h ; done
+while true ; do env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8488 pkgs sync-profile --sync-config /opt/etc/rebuilderd-sync-riscv64.conf debian-main --print-json | jq '.[] | select(.architecture != "all")' | jq -s | env REBUILDERD_COOKIE_PATH=~/.local/share/rebuilderd-auth-cookie /opt/usr/bin/rebuildctl -H http://127.0.0.1:8488 pkgs sync-stdin debian main ; ST=$(shuf -i 150-210 -n 1) ; echo sleeping ${ST}m now ; sleep ${ST}m ; done
# with rebuilderd-worker from trixie:
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/b22ba890c8e108fb3143f83492367a62e09ac1bd...f6a87edd2b545b553a35ecd5c6acdf329bf90bad
--
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/b22ba890c8e108fb3143f83492367a62e09ac1bd...f6a87edd2b545b553a35ecd5c6acdf329bf90bad
You're receiving this email because of your account on salsa.debian.org.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20250305/dda9b6e0/attachment-0001.htm>
More information about the Qa-jenkins-scm
mailing list