[Qa-jenkins-scm] [Git][qa/jenkins.debian.net][master] 3 commits: update lists of tested Debian suite names in README

Holger Levsen (@holger) gitlab at salsa.debian.org
Fri Jun 16 16:21:08 BST 2023



Holger Levsen pushed to branch master at Debian QA / jenkins.debian.net


Commits:
4684a08b by Holger Levsen at 2023-06-16T17:09:34+02:00
update lists of tested Debian suite names in README

Signed-off-by: Holger Levsen <holger at layer-acht.org>

- - - - -
9b886cfb by Holger Levsen at 2023-06-16T17:11:43+02:00
reproducible Debian: add trixie to URL redirects

Signed-off-by: Holger Levsen <holger at layer-acht.org>

- - - - -
acff30da by Holger Levsen at 2023-06-16T17:20:36+02:00
find_obsolete_transitional_packages: adjust for trixie

Signed-off-by: Holger Levsen <holger at layer-acht.org>

- - - - -


5 changed files:

- README
- TODO
- bin/find_obsolete_transitional_packages.sh
- hosts/jenkins/etc/apache2/reproduciblemap.conf
- job-cfg/obsolete-transitional.yaml


Changes:

=====================================
README
=====================================
@@ -118,7 +118,7 @@ Installation tests inside chroot environments.
 
 * The (current) purpose of https://tests.reproducible-builds.org is to show the potential of reproducible builds for Debian - and six other projects currently. This is research, showing what could (and should) be done... check https://wiki.debian.org/ReproducibleBuilds for the real status of the project for Debian!
 
-* For Debian, six suites, 'stretch', 'buster', 'bullseye', 'bookworm', 'unstable' and 'experimental', are tested on four architectures: 'amd64', 'i386', 'arm64' and 'armhf'. The tests are done using 'pbuilder' through several concurrent workers: 40 for 'amd64', 24 for 'i386', 32 for 'arm64' and 45 for 'armhf', which are each constantly testing packages and saving the results of these tests. There's a single link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_build_service.sh[systemd service] starting all of these link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_worker.sh[workers] which in turn launch the actual link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_build.sh[build script]. (So the actual builds and tests are happening outside the jenkins service.)
+* For Debian, six suites, 'buster', 'bullseye', 'bookworm', 'trixie', 'unstable' and 'experimental', are tested on four architectures: 'amd64', 'i386', 'arm64' and 'armhf'. The tests are done using 'pbuilder' through several concurrent workers: 40 for 'amd64', 24 for 'i386', 32 for 'arm64' and 45 for 'armhf', which are each constantly testing packages and saving the results of these tests. There's a single link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_build_service.sh[systemd service] starting all of these link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_worker.sh[workers] which in turn launch the actual link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_build.sh[build script]. (So the actual builds and tests are happening outside the jenkins service.)
 ** To shutdown all the workers use:  `sudo systemctl stop reproducible_build at startup.service ; /srv/jenkins/bin/reproducible_cleanup_nodes.sh`
 ** To start all the workers use: `sudo systemctl start reproducible_build at startup.service`
 
@@ -135,7 +135,7 @@ Installation tests inside chroot environments.
 * We would love to have more or more powerful ARM hardware in the future, if you can help, please talk to us!
 
 * Packages to be build are scheduled in the database via a scheduler job, which runs every hour and if the queue is below a certain threshold schedules four types of packages:
-** new untested packages (either uploaded to 'unstable' or 'experimental' or migrated to 'bookworm', or security updates to 'bullseye', 'buster' or 'stretch'),
+** new untested packages (either uploaded to 'unstable' or 'experimental' or migrated to 'trixie', or security updates to 'bookworm', 'bullseye' or 'buster'),
 ** new versions of existing packages, which were already tested - these are always scheduled, no matter how full the queue is
 ** old versions, already tested (at least two weeks ago)
 ** and also some old versions which failed to build (at least ten days ago), if no bug has been filed.


=====================================
TODO
=====================================
@@ -43,8 +43,11 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
 ** add trixie to the suites in reproducible_pool_buildinfos.sh
 ** adjust chroot_installation- jobs
 ** tweak jenkins-shell-monitor.sh as needed
+** add trixie to URL redirects in hosts/jenkins/etc/apache2/reproduciblemap.conf
 ** adjust multiarch jobs in job-cfg/udd.yaml
 ** add chroot-installation trixie jobs to build_jenkins_job_health_page in maintenance.sh
+** update find_obsolete_transitional_packages.sh and job-cfg/obsolete-transitional.yaml
+** update suite names in README
 ** upgrade i386 nodes to bookworm
 ** upgrade amd64 nodes to bookworm (except jenkins)
 *** see below for how to upgrade to postgresql-15 on ionos7
@@ -54,7 +57,6 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
 
 * things still to be done after the bookworm release and as trixie is open for development
 ** update reproducible_common.sh with regards to the usrmerge variation in certain suites
-** update find_obsolete_transitional_packages.sh
 ** maybe wait til 12.1 (= ~1 month) until we upgrade jenkins to bookworm, let's see
 *** upgrade to postgresql-15:
 ----


=====================================
bin/find_obsolete_transitional_packages.sh
=====================================
@@ -11,8 +11,7 @@ MAX=20
 if [ -z "$1" ] ; then
 	echo "Call $(basename $0) [bug] NEXT STABLE OLDSTABLE"
 	echo "         bug to enter manual mode"
-	echo "         NEXT suite which is being developed, eg 'bookworm'"
-	echo "         STABLE is bullseye currently, OLDSTABLE is buster"
+	echo "         NEXT suite which is being developed, eg 'trixie'"
 	exit 0
 fi
 
@@ -24,8 +23,8 @@ else
 	#normally defined in common-functions.sh
 	export MIRROR=http://deb.debian.org/debian
 	#for quicker development:
-	PACKAGES[0]=/home/schroots/bookworm/var/lib/apt/lists/deb.debian.org_debian_dists_bookworm_main_binary-amd64_Packages
-	PACKAGES[1]=/var/lib/apt/lists/deb.debian.org_debian_dists_bullseye_main_binary-amd64_Packages
+	PACKAGES[0]=/home/schroots/trixie/var/lib/apt/lists/deb.debian.org_debian_dists_trixie_main_binary-amd64_Packages
+	PACKAGES[1]=/var/lib/apt/lists/deb.debian.org_debian_dists_bookworm_main_binary-amd64_Packages
 	PACKAGES[2]=/home/schroots/sid/var/lib/apt/lists/deb.debian.org_debian_dists_sid_main_binary-amd64_Packages
 fi
 
@@ -68,7 +67,9 @@ BUGGED="multiarch-support jadetex dh-systemd libpcap-dev transfig myspell-it mys
 BUGGED="$BUGGED actionaz agda-mode android-tools-adb android-tools-fastboot backintime-gnome backintime-kde beignet bird-bgp chocolate-doom chocolate-common science-astronomy science-astronomy-dev kdesdk-dolphin-plugins ttf-femkeklaver ttf-goudybookletter geany-plugin-gproject gnome-packagekit-session gpgv2 golang-check.v1-dev golang-codegangsta-cli-dev golang-context-dev golang-github-jfrazelle-go-dev golang-snappy-go-dev golang-github-lsegal-gucumber-dev golang-clockwork-dev golang-pq-dev golang-dns-dev golang-mreiferson-httpclient-dev golang-uuid-dev golang-prometheus-client-dev golang-gogoprotobuf-dev golang-go.net-dev golang-go.tools golang-go.tools-dev golang-logrus-dev golang-objx-dev golang-pretty-dev golang-text-dev golang-toml-dev golang-websocket-dev golang-x-text-dev golang-yaml.v2-dev md5deep xul-ext-https-everywhere iptables-dev iptraf ksnapshot kdoctools-dev kio-dev kwayland-dev bsdcpio bsdtar libkf5sysguard5 libkf5sysguard5-data gstreamer0.10-qapt python-libvoikko lua-luxio0 magit mongodb-dev libmpfi0-dev blast2 notmuch-emacs libpango1.0-0 paredit-el ruby-passenger ruby-passenger-doc python-pelican pep8 php-gettext pike8.0-manual pinentry-qt4 kde-config-touchpad plowshare4 polkit-kde-1 gpaco paco puppet-common puppetmaster puppetmaster-passenger python-pytango python3-pytango letsencrypt python-certbot-apache python-certbot-nginx python-dogpile.core python3-dogpile.core ipython-qtconsole ipython3-qtconsole iep gtk-redshift ruby-bson-ext ruby-archive-tar-minitar aterm aterm-ml libsaga golang-github-ubuntu-core-snappy-dev python-spyderlib python3-spyderlib squid3 luasseq ttf-ancient-fonts vnc4server xvnc4viewer aspell-eu-es hunspell-eu-es"
 # since bullseye release
 BUGGED="$BUGGED acedb-other-belvu acedb-other-dotter libapache2-mod-md libapache2-mod-proxy-uwsgi apertium-es-ca apertium-es-it apt-transport-https auto-complete-el libbabeltrace-ctf-dev libbabeltrace-ctf1 myspell-bg gtk3-engines-breeze buildbot-slave python3-buildbot python3-buildbot-doc python3-buildbot-worker migemo-el compiz-plugins-default science-electronics xul-ext-debianbuttons docker qemu-efi libmaven-exec-plugin-java fonts-hack-otf fonts-hack-ttf fonts-hack-web fonts-roboto-hinted gambas3-gb-gui-opengl gambas3-gb-gui-qt gambas3-gb-gui-qt-webkit gambas3-gb-gui-trayicon libgarcon-1-0-dev gnupg-agent golang-mode golang-go-semver-dev haskell-mode myspell-lv icewm-lite libintellij-annotations-java libintellij-annotations-java-doc natpmp-utils libratbag-tools hunspell-gl-es hunspell-sv-se myspell-hr myspell-pl liblz4-tool mat libegl1-mesa libgl1-mesa-glx libgles2-mesa libwayland-egl1-mesa myspell-pt-br myspell-pt-pt libncurses5-dev libncursesw5-dev libtinfo-dev tor-arm slapd-smbk5pwd pdftk skytools3-ticker libplexus-classworlds2-java libplexus-container-default1.5-java python3-dicom pyotherside idle3 myspell-ru libservlet3.1-java silversearcher-ag-el snap-confine ubuntu-core-launcher libtiff5-dev xul-ext-treestyletab libuim-data verbiste-el libwagon-java x11proto-core-dev x11proto-dri2-dev x11proto-fonts-dev x11proto-gl-dev x11proto-input-dev x11proto-kb-dev x11proto-present-dev x11proto-randr-dev x11proto-record-dev x11proto-render-dev x11proto-scrnsaver-dev x11proto-video-dev x11proto-xext-dev x11proto-xf86dga-dev x11proto-xf86dri-dev x11proto-xf86vidmode-dev x11proto-xinerama-dev libzeroc-ice-java zeroc-ice-utils-java"
-# to be continued after the bookworm release
+# since bookworm release
+# ...
+# to be continued after the trixie release
 
 echo "Looking at $SUITES for obsolete transitional packages in $NEXT."
 BASEPATH=$(ls -1d /tmp/transitional-????? 2>/dev/null || true)


=====================================
hosts/jenkins/etc/apache2/reproduciblemap.conf
=====================================
@@ -99,11 +99,11 @@ RewriteRule ^/debian/testing/(.*) /debian/bullseye/$1
 
 # redirect /$suite to /$suite/index_suite_amd64_stats.html
 # note: the missing slash in the RewriteRule is wanted to avoid a double slash
-RewriteCond %{REQUEST_URI} ^/(debian/|)(stretch|buster|bullseye|bookworm|unstable|experimental)(/|)$
+RewriteCond %{REQUEST_URI} ^/(debian/|)(stretch|buster|bullseye|bookworm|trixie|unstable|experimental)(/|)$
 RewriteRule ^/(debian/|)(.*) /debian/$2/index_suite_amd64_stats.html [R,L]
 
 # redirect /$suite/$arch to $suite/index_suite_$arch_stats.html
-RewriteCond %{REQUEST_URI} ^/(debian/|)(stretch|buster|bullseye|bookworm|unstable|experimental)/(amd64|arm64|armhf|i386)(/|)$
+RewriteCond %{REQUEST_URI} ^/(debian/|)(stretch|buster|bullseye|bookworm|trixie|unstable|experimental)/(amd64|arm64|armhf|i386)(/|)$
 RewriteRule ^/(debian/|)([a-z0-9]+)/([a-z0-9]+) /debian/$2/index_suite_$3_stats.html [R,L]
 
 # redirect /$arch to /unstable/index_suite_$arch_stats.html


=====================================
job-cfg/obsolete-transitional.yaml
=====================================
@@ -17,7 +17,7 @@
       artifactDaysToKeep: -1
       artifactNumToKeep: -1
     builders:
-      - shell: '/srv/jenkins/bin/find_obsolete_transitional_packages.sh bookworm bullseye buster'
+      - shell: '/srv/jenkins/bin/find_obsolete_transitional_packages.sh trixie bookworm bullseye'
     publishers:
       - logparser:
           parse-rules: '/srv/jenkins/logparse/obsolete-transitional.rules'



View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/02ea4b74f60d8e013908f474445df5917ee0bcb2...acff30da3d2e1180c20e32e09a2da038375f6f5c

-- 
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/02ea4b74f60d8e013908f474445df5917ee0bcb2...acff30da3d2e1180c20e32e09a2da038375f6f5c
You're receiving this email because of your account on salsa.debian.org.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20230616/b5b66a20/attachment-0001.htm>


More information about the Qa-jenkins-scm mailing list