[Qa-jenkins-scm] [Git][qa/jenkins.debian.net][master] 3 commits: reproducible Debian rebuilder 'thing': further planing
Holger Levsen
gitlab at salsa.debian.org
Fri May 1 02:18:44 BST 2020
Holger Levsen pushed to branch master at Debian QA / jenkins.debian.net
Commits:
2ac104da by Holger Levsen at 2020-05-01T02:57:31+02:00
reproducible Debian rebuilder 'thing': further planing
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
6c8f8572 by Holger Levsen at 2020-05-01T03:13:53+02:00
reproducible Debian rebuilder 'thing': better describe the goals
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
d1545750 by Holger Levsen at 2020-05-01T03:18:22+02:00
reproducible Debian rebuilder 'thing': improve hackish fix for a yet to be filed bug against debrebuild in devscripts...
Signed-off-by: Holger Levsen <holger at layer-acht.org>
- - - - -
3 changed files:
- TODO
- bin/rb-debrebuild
- bin/reproducible_debian_rebuilder_prototype.sh
Changes:
=====================================
TODO
=====================================
@@ -67,6 +67,7 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
** 1st step: download a specific .buildinfo file and sbuild it - done
** 2nd step: choose a random package from bullseye and fetch the .buildinfo file from builtin-pho and build it - done
*** next: file a wishlist bug for the DIST_BASE= feature...
+*** then: find the NEXT in the code and go to step 3
** 3rd step: put result in db in pb7
** 4th step: have some scheduler job and a rebuilder job picking up tasks
*** scheduler on pb7
=====================================
bin/rb-debrebuild
=====================================
@@ -483,7 +483,7 @@ print "------------\n";
print "\n";
print "You can try to build the package with sbuild like this:\n";
print "\n";
-print "$environment sbuild";
+print "SBUILD_CMDLINE=$environment sbuild";
open(FH, '<', "$tempdir/etc/apt/sources.list");
while (my $line = <FH>) {
=====================================
bin/reproducible_debian_rebuilder_prototype.sh
=====================================
@@ -6,19 +6,19 @@
cat << EOF
-############################################################################################
-### ###
-### the goal is to create json export to integrate in tracker.d.o and/or packages.d.o ###
-### ###
-### another goal (implied in the one above) is to develop a 'real world' view about the ###
-### reproducibility of the packages distributed via ftp.d.o. - so far tests.r-b.o/debian ###
-### only shows the 'theoretical' reproducibility of Debian packages. ###
-### ###
-### we'll leave out the problem of 'trust' here quite entirely. that's why it's called ###
-### a Debian rebuilder 'thing', to explore technical feasibility, duck taping our way ###
-### ahead, keeping our motto 'to allow anyone to independently verify...' in mind. ###
-### ###
-############################################################################################
+###########################################################################################
+### ###
+### the goal is to create json export to integrate in tracker.d.o and/or packages.d.o ###
+### ###
+### the aim is to develop a 'real world' view about the reproducibility of all the ###
+### packages distributed via ftp.d.o. - so far tests.r-b.o/debian only shows the ###
+### 'theoretical' reproducibility of Debian packages. ###
+### ###
+### we'll leave out the problem of 'trust' here quite entirely. that's why it's called ###
+### a Debian rebuilder 'thing', to explore technical feasibility, duck taping our way ###
+### ahead, keeping our motto 'to allow anyone to independently verify...' in mind. ###
+### ###
+###########################################################################################
EOF
@@ -51,7 +51,6 @@ set_poolpath() {
#
# we want packages in bullseye first
-CHPATH=/srv/reproducible-results/chdist # FIXME: remove redudancy added for easier testing
ARCH=amd64
SUITE=bullseye
DISTNAME="$SUITE-$ARCH"
@@ -77,7 +76,9 @@ set_poolpath $PKG # so we can set it here with a function
FTPMASTERPATH="$(echo $BUILTINPHOPATH | cut -d '/' -f2-4)"
URLPATH="https://buildinfos.debian.net/ftp-master.debian.org/buildinfo/$FTPMASTERPATH/"
-# FIXME: hack, should be done better, also with cleanup *after* the job run...
+# FIXME: we need locking to enable concurrent job runs
+
+# FIXME: hack, should be done properly, with cleanup *after* the job run...
mkdir -p $PWD/rebuilder-prototype
BTPKG="$PWD/rebuilder-prototype/$PKG"
mkdir $BTPKG || (rm $BTPKG -r ; mkdir $BTPKG)
@@ -134,8 +135,8 @@ echo 'Acquire::Check-Valid-Until "false";' | sudo tee /schroots/debrebuild-$DIST
# - using sed
# - workaround yet unfiled bug in devscript by tail -2 | grep -v BASE_DIST... (see above)
output_echo "trying to re-sbuild $PKG..."
-SBUILD=$(tail -2 $DEBREBUILD | grep -v '^BASE_DIST=' | sed 's# sbuild # sbuild --no-run-lintian #')
-output_echo "using this sbuild call:"
+SBUILD=$(tail -2 $DEBREBUILD | grep '^SBUILD_CMDLINE=' | cut -d '=' -f2- | sed 's# sbuild # sbuild --no-run-lintian #')
+output_echo "using this sbuild command line:"
echo $SBUILD
echo
eval $SBUILD
@@ -152,6 +153,7 @@ for DEB in $(dcmd ls *.changes|egrep 'deb$' ) ; do
if grep $SHASUM $FILE.orig ; then
# reproducible, yay!
:
+ # FIXME: NEXT: put this in the db and prevent rebuilds (way before)...
else
BADDEBS="$BADDEBS $DEB"
fi
@@ -161,6 +163,7 @@ if [ -n "$BADDEBS" ] ; then
for DEB in $BADDEBS ; do
echo " $(egrep ' [a-z0-9]{64} ' $FILE.orig|grep $DEB | awk ' { print $1 " " $3 }') from ftp.debian.org"
echo " $(sha256sum $DEB| sed 's# # #') from the current rebuild"
+ echo "hmmmmmpppf."
done
fi
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/54cf39c654db1f15bda448ffc6d7c913b463126a...d15457503d2a6720876f68e4b2776654a5ea1887
--
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/54cf39c654db1f15bda448ffc6d7c913b463126a...d15457503d2a6720876f68e4b2776654a5ea1887
You're receiving this email because of your account on salsa.debian.org.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20200501/363cca24/attachment-0001.html>
More information about the Qa-jenkins-scm
mailing list