[Qa-jenkins-scm] [Git][qa/jenkins.debian.net][master] 2 commits: reproducible Debian rebuilder 'thing': document more bugs in debrebuild

[Holger Levsen]

Holger Levsen pushed to branch master at Debian QA / jenkins.debian.net


Commits:
e1b6201c by Holger Levsen at 2020-05-03T16:20:22+02:00
reproducible Debian rebuilder 'thing': document more bugs in debrebuild

Signed-off-by: Holger Levsen <holger at layer-acht.org>

- - - - -
50f450ce by Holger Levsen at 2020-05-03T16:27:31+02:00
reproducible Debian rebuilder 'thing': do not try to create schroot if it exists

Signed-off-by: Holger Levsen <holger at layer-acht.org>

- - - - -


2 changed files:

- TODO
- bin/reproducible_debian_rebuilder_prototype.sh


Changes:

=====================================
TODO
=====================================
@@ -68,7 +68,12 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
 ** 2nd step: choose a random package from bullseye and fetch the .buildinfo file from builtin-pho and build it - done
 *** done: deal with unsigned .buildinfo files, some buildds published a lot of those
 *** next: file a wishlist bug for the DIST_BASE= feature...
+*** next: file a normal bug for the unclear error messages regarding unavailable build-depends
+*** next: file a wishlist for downloading the source and verifying it against the .buildinfo file
+*** next: file a normal bug about generating a wrong cmdline for binNMU rebuilds and failing to modify changelog. (block this bug by the download sources feature)
 ** 3rd step: put result in db in pb7: search for NEXT in the _prototype.sh
+*** prelimanary db:
+**** buildinfofileurl, source, source version, binary version, binary, rebuild_status, rebuildlogurl
 ** 4th step: have some scheduler job and a rebuilder job picking up tasks
 *** scheduler on pb7
 *** rebuilds on osuosl173
@@ -89,7 +94,7 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
 ** also treat the base suite archive and its security, update and backports archives seperatly
 *** store hash of processed Packages file and only process a Packages file if it has an unknown hash -> good for suites which are not updated often
 *** ignore security archive as those .buildinfo files are not published yet (#862538)
-** good examples: piuparts (arch and any), d-e-i (udeb), d-e-c (all only), emacs (epoch)
+** good examples: piuparts (arch and any), d-e-i (udeb), d-e-c (all only), emacs (epoch) libunibreak (binNMU)
 
 
 ==== proper backup


=====================================
bin/reproducible_debian_rebuilder_prototype.sh
=====================================
@@ -92,7 +92,7 @@ FTPMASTERPATH="$(echo $BUILTINPHOPATH | cut -d '/' -f2-4)"
 URLPATH="https://buildinfos.debian.net/ftp-master.debian.org/buildinfo/$FTPMASTERPATH"
 
 if [ "$VERSION" != "$BINARY_VERSION" ] ; then
-	output_echo "Warning: .buildinfo files known for $PKG and $VERSION is $URL_PATH/$FILE this indicates a binNMU because $VERSION != $BINARY_VERSION..."
+	output_echo "Warning: .buildinfo file known for $PKG and $VERSION is $URL_PATH/$FILE: this indicates a binNMU because $VERSION != $BINARY_VERSION."
 	# TODO: what about packages with an epoch?
 fi
 
@@ -161,13 +161,19 @@ case $DISTRO in
 		fi
 		;;
 esac
-output_echo "preparing chroot for $DISTRO"
-# FIXME: "|| true" is dummy code for regenerating this chroot every other week or so
-sudo sbuild-createchroot $DISTRO /schroots/debrebuild-$DISTRO-amd64 http://deb.debian.org/debian || true
 
-# I'm a bit surprised this was needed, as debrebuild has code for this...
-# FIXME: a bug should probably be file for this as well
-echo 'Acquire::Check-Valid-Until "false";' | sudo tee /schroots/debrebuild-$DISTRO-amd64/etc/apt/apt.conf.d/23-rebuild
+# create chroot for sbuild
+if [ -d /schroots/debrebuild-$DISTRO-$ARCH ] ; then
+	output_echo "chroot for $DISTRO/$ARCH exists, good."
+else
+	output_echo "preparing chroot for $DISTRO/$ARCH."
+	# FIXME: "|| true" is dummy code for regenerating this chroot every other week or so
+	sudo sbuild-createchroot $DISTRO /schroots/debrebuild-$DISTRO-$ARCH http://deb.debian.org/debian || true
+
+	# I'm a bit surprised this was needed, as debrebuild has code for this...
+	# FIXME: a bug should probably be filed for this as well
+	echo 'Acquire::Check-Valid-Until "false";' | sudo tee /schroots/debrebuild-$DISTRO-$ARCH/etc/apt/apt.conf.d/23-rebuild
+fi
 
 # actually run sbuild
 # - workaround #955123 in devscripts: debrebuild: please provide --sbuild-output-only option



View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/26bf92ba5d32a7cebe0dcddbb28174d7bd4b9e4c...50f450ce03b6bd1ef2737d7353a207d970c8a84e

-- 
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/26bf92ba5d32a7cebe0dcddbb28174d7bd4b9e4c...50f450ce03b6bd1ef2737d7353a207d970c8a84e
You're receiving this email because of your account on salsa.debian.org.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20200503/5d122f5f/attachment-0001.html>