[Qa-jenkins-scm] [Git][qa/jenkins.debian.net][master] 3 commits: update lists of tested Debian suite names in README
Holger Levsen (@holger)
gitlab at salsa.debian.org
Fri Jun 16 16:21:08 BST 2023
Holger Levsen pushed to branch master at Debian QA / jenkins.debian.net
Commits:
4684a08b by Holger Levsen at 2023-06-16T17:09:34+02:00
update lists of tested Debian suite names in README
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
9b886cfb by Holger Levsen at 2023-06-16T17:11:43+02:00
reproducible Debian: add trixie to URL redirects
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
acff30da by Holger Levsen at 2023-06-16T17:20:36+02:00
find_obsolete_transitional_packages: adjust for trixie
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
5 changed files:
- README
- TODO
- bin/find_obsolete_transitional_packages.sh
- hosts/jenkins/etc/apache2/reproduciblemap.conf
- job-cfg/obsolete-transitional.yaml
Changes:
=====================================
README
=====================================
@@ -118,7 +118,7 @@ Installation tests inside chroot environments.
* The (current) purpose of https://tests.reproducible-builds.org is to show the potential of reproducible builds for Debian - and six other projects currently. This is research, showing what could (and should) be done... check https://wiki.debian.org/ReproducibleBuilds for the real status of the project for Debian!
-* For Debian, six suites, 'stretch', 'buster', 'bullseye', 'bookworm', 'unstable' and 'experimental', are tested on four architectures: 'amd64', 'i386', 'arm64' and 'armhf'. The tests are done using 'pbuilder' through several concurrent workers: 40 for 'amd64', 24 for 'i386', 32 for 'arm64' and 45 for 'armhf', which are each constantly testing packages and saving the results of these tests. There's a single link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_build_service.sh[systemd service] starting all of these link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_worker.sh[workers] which in turn launch the actual link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_build.sh[build script]. (So the actual builds and tests are happening outside the jenkins service.)
+* For Debian, six suites, 'buster', 'bullseye', 'bookworm', 'trixie', 'unstable' and 'experimental', are tested on four architectures: 'amd64', 'i386', 'arm64' and 'armhf'. The tests are done using 'pbuilder' through several concurrent workers: 40 for 'amd64', 24 for 'i386', 32 for 'arm64' and 45 for 'armhf', which are each constantly testing packages and saving the results of these tests. There's a single link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_build_service.sh[systemd service] starting all of these link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_worker.sh[workers] which in turn launch the actual link:https://salsa.debian.org/qa/jenkins.debian.net/blob/master/bin/reproducible_build.sh[build script]. (So the actual builds and tests are happening outside the jenkins service.)
** To shutdown all the workers use: `sudo systemctl stop reproducible_build at startup.service ; /srv/jenkins/bin/reproducible_cleanup_nodes.sh`
** To start all the workers use: `sudo systemctl start reproducible_build at startup.service`
@@ -135,7 +135,7 @@ Installation tests inside chroot environments.
* We would love to have more or more powerful ARM hardware in the future, if you can help, please talk to us!
* Packages to be build are scheduled in the database via a scheduler job, which runs every hour and if the queue is below a certain threshold schedules four types of packages:
-** new untested packages (either uploaded to 'unstable' or 'experimental' or migrated to 'bookworm', or security updates to 'bullseye', 'buster' or 'stretch'),
+** new untested packages (either uploaded to 'unstable' or 'experimental' or migrated to 'trixie', or security updates to 'bookworm', 'bullseye' or 'buster'),
** new versions of existing packages, which were already tested - these are always scheduled, no matter how full the queue is
** old versions, already tested (at least two weeks ago)
** and also some old versions which failed to build (at least ten days ago), if no bug has been filed.
=====================================
TODO
=====================================
@@ -43,8 +43,11 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
** add trixie to the suites in reproducible_pool_buildinfos.sh
** adjust chroot_installation- jobs
** tweak jenkins-shell-monitor.sh as needed
+** add trixie to URL redirects in hosts/jenkins/etc/apache2/reproduciblemap.conf
** adjust multiarch jobs in job-cfg/udd.yaml
** add chroot-installation trixie jobs to build_jenkins_job_health_page in maintenance.sh
+** update find_obsolete_transitional_packages.sh and job-cfg/obsolete-transitional.yaml
+** update suite names in README
** upgrade i386 nodes to bookworm
** upgrade amd64 nodes to bookworm (except jenkins)
*** see below for how to upgrade to postgresql-15 on ionos7
@@ -54,7 +57,6 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
* things still to be done after the bookworm release and as trixie is open for development
** update reproducible_common.sh with regards to the usrmerge variation in certain suites
-** update find_obsolete_transitional_packages.sh
** maybe wait til 12.1 (= ~1 month) until we upgrade jenkins to bookworm, let's see
*** upgrade to postgresql-15:
----
=====================================
bin/find_obsolete_transitional_packages.sh
=====================================
@@ -11,8 +11,7 @@ MAX=20
if [ -z "$1" ] ; then
echo "Call $(basename $0) [bug] NEXT STABLE OLDSTABLE"
echo " bug to enter manual mode"
- echo " NEXT suite which is being developed, eg 'bookworm'"
- echo " STABLE is bullseye currently, OLDSTABLE is buster"
+ echo " NEXT suite which is being developed, eg 'trixie'"
exit 0
fi
@@ -24,8 +23,8 @@ else
#normally defined in common-functions.sh
export MIRROR=http://deb.debian.org/debian
#for quicker development:
- PACKAGES[0]=/home/schroots/bookworm/var/lib/apt/lists/deb.debian.org_debian_dists_bookworm_main_binary-amd64_Packages
- PACKAGES[1]=/var/lib/apt/lists/deb.debian.org_debian_dists_bullseye_main_binary-amd64_Packages
+ PACKAGES[0]=/home/schroots/trixie/var/lib/apt/lists/deb.debian.org_debian_dists_trixie_main_binary-amd64_Packages
+ PACKAGES[1]=/var/lib/apt/lists/deb.debian.org_debian_dists_bookworm_main_binary-amd64_Packages
PACKAGES[2]=/home/schroots/sid/var/lib/apt/lists/deb.debian.org_debian_dists_sid_main_binary-amd64_Packages
fi
@@ -68,7 +67,9 @@ BUGGED="multiarch-support jadetex dh-systemd libpcap-dev transfig myspell-it mys
BUGGED="$BUGGED actionaz agda-mode android-tools-adb android-tools-fastboot backintime-gnome backintime-kde beignet bird-bgp chocolate-doom chocolate-common science-astronomy science-astronomy-dev kdesdk-dolphin-plugins ttf-femkeklaver ttf-goudybookletter geany-plugin-gproject gnome-packagekit-session gpgv2 golang-check.v1-dev golang-codegangsta-cli-dev golang-context-dev golang-github-jfrazelle-go-dev golang-snappy-go-dev golang-github-lsegal-gucumber-dev golang-clockwork-dev golang-pq-dev golang-dns-dev golang-mreiferson-httpclient-dev golang-uuid-dev golang-prometheus-client-dev golang-gogoprotobuf-dev golang-go.net-dev golang-go.tools golang-go.tools-dev golang-logrus-dev golang-objx-dev golang-pretty-dev golang-text-dev golang-toml-dev golang-websocket-dev golang-x-text-dev golang-yaml.v2-dev md5deep xul-ext-https-everywhere iptables-dev iptraf ksnapshot kdoctools-dev kio-dev kwayland-dev bsdcpio bsdtar libkf5sysguard5 libkf5sysguard5-data gstreamer0.10-qapt python-libvoikko lua-luxio0 magit mongodb-dev libmpfi0-dev blast2 notmuch-emacs libpango1.0-0 paredit-el ruby-passenger ruby-passenger-doc python-pelican pep8 php-gettext pike8.0-manual pinentry-qt4 kde-config-touchpad plowshare4 polkit-kde-1 gpaco paco puppet-common puppetmaster puppetmaster-passenger python-pytango python3-pytango letsencrypt python-certbot-apache python-certbot-nginx python-dogpile.core python3-dogpile.core ipython-qtconsole ipython3-qtconsole iep gtk-redshift ruby-bson-ext ruby-archive-tar-minitar aterm aterm-ml libsaga golang-github-ubuntu-core-snappy-dev python-spyderlib python3-spyderlib squid3 luasseq ttf-ancient-fonts vnc4server xvnc4viewer aspell-eu-es hunspell-eu-es"
# since bullseye release
BUGGED="$BUGGED acedb-other-belvu acedb-other-dotter libapache2-mod-md libapache2-mod-proxy-uwsgi apertium-es-ca apertium-es-it apt-transport-https auto-complete-el libbabeltrace-ctf-dev libbabeltrace-ctf1 myspell-bg gtk3-engines-breeze buildbot-slave python3-buildbot python3-buildbot-doc python3-buildbot-worker migemo-el compiz-plugins-default science-electronics xul-ext-debianbuttons docker qemu-efi libmaven-exec-plugin-java fonts-hack-otf fonts-hack-ttf fonts-hack-web fonts-roboto-hinted gambas3-gb-gui-opengl gambas3-gb-gui-qt gambas3-gb-gui-qt-webkit gambas3-gb-gui-trayicon libgarcon-1-0-dev gnupg-agent golang-mode golang-go-semver-dev haskell-mode myspell-lv icewm-lite libintellij-annotations-java libintellij-annotations-java-doc natpmp-utils libratbag-tools hunspell-gl-es hunspell-sv-se myspell-hr myspell-pl liblz4-tool mat libegl1-mesa libgl1-mesa-glx libgles2-mesa libwayland-egl1-mesa myspell-pt-br myspell-pt-pt libncurses5-dev libncursesw5-dev libtinfo-dev tor-arm slapd-smbk5pwd pdftk skytools3-ticker libplexus-classworlds2-java libplexus-container-default1.5-java python3-dicom pyotherside idle3 myspell-ru libservlet3.1-java silversearcher-ag-el snap-confine ubuntu-core-launcher libtiff5-dev xul-ext-treestyletab libuim-data verbiste-el libwagon-java x11proto-core-dev x11proto-dri2-dev x11proto-fonts-dev x11proto-gl-dev x11proto-input-dev x11proto-kb-dev x11proto-present-dev x11proto-randr-dev x11proto-record-dev x11proto-render-dev x11proto-scrnsaver-dev x11proto-video-dev x11proto-xext-dev x11proto-xf86dga-dev x11proto-xf86dri-dev x11proto-xf86vidmode-dev x11proto-xinerama-dev libzeroc-ice-java zeroc-ice-utils-java"
-# to be continued after the bookworm release
+# since bookworm release
+# ...
+# to be continued after the trixie release
echo "Looking at $SUITES for obsolete transitional packages in $NEXT."
BASEPATH=$(ls -1d /tmp/transitional-????? 2>/dev/null || true)
=====================================
hosts/jenkins/etc/apache2/reproduciblemap.conf
=====================================
@@ -99,11 +99,11 @@ RewriteRule ^/debian/testing/(.*) /debian/bullseye/$1
# redirect /$suite to /$suite/index_suite_amd64_stats.html
# note: the missing slash in the RewriteRule is wanted to avoid a double slash
-RewriteCond %{REQUEST_URI} ^/(debian/|)(stretch|buster|bullseye|bookworm|unstable|experimental)(/|)$
+RewriteCond %{REQUEST_URI} ^/(debian/|)(stretch|buster|bullseye|bookworm|trixie|unstable|experimental)(/|)$
RewriteRule ^/(debian/|)(.*) /debian/$2/index_suite_amd64_stats.html [R,L]
# redirect /$suite/$arch to $suite/index_suite_$arch_stats.html
-RewriteCond %{REQUEST_URI} ^/(debian/|)(stretch|buster|bullseye|bookworm|unstable|experimental)/(amd64|arm64|armhf|i386)(/|)$
+RewriteCond %{REQUEST_URI} ^/(debian/|)(stretch|buster|bullseye|bookworm|trixie|unstable|experimental)/(amd64|arm64|armhf|i386)(/|)$
RewriteRule ^/(debian/|)([a-z0-9]+)/([a-z0-9]+) /debian/$2/index_suite_$3_stats.html [R,L]
# redirect /$arch to /unstable/index_suite_$arch_stats.html
=====================================
job-cfg/obsolete-transitional.yaml
=====================================
@@ -17,7 +17,7 @@
artifactDaysToKeep: -1
artifactNumToKeep: -1
builders:
- - shell: '/srv/jenkins/bin/find_obsolete_transitional_packages.sh bookworm bullseye buster'
+ - shell: '/srv/jenkins/bin/find_obsolete_transitional_packages.sh trixie bookworm bullseye'
publishers:
- logparser:
parse-rules: '/srv/jenkins/logparse/obsolete-transitional.rules'
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/02ea4b74f60d8e013908f474445df5917ee0bcb2...acff30da3d2e1180c20e32e09a2da038375f6f5c
--
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/02ea4b74f60d8e013908f474445df5917ee0bcb2...acff30da3d2e1180c20e32e09a2da038375f6f5c
You're receiving this email because of your account on salsa.debian.org.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20230616/b5b66a20/attachment-0001.htm>
More information about the Qa-jenkins-scm
mailing list