[Qa-jenkins-scm] [Git][qa/jenkins.debian.net][master] 2 commits: reproducible Debian rebuilder 'thing': improve description of goals and next steps

[Holger Levsen]

Holger Levsen pushed to branch master at Debian QA / jenkins.debian.net


Commits:
2b3f2292 by Holger Levsen at 2020-05-01T00:40:37+02:00
reproducible Debian rebuilder 'thing': improve description of goals and next steps

Signed-off-by: Holger Levsen <holger at layer-acht.org>

- - - - -
c20e5480 by Holger Levsen at 2020-05-01T00:42:33+02:00
fixup 44590e36c and disable debugging

Signed-off-by: Holger Levsen <holger at layer-acht.org>

- - - - -


2 changed files:

- TODO
- bin/reproducible_debian_rebuilder_prototype.sh


Changes:

=====================================
TODO
=====================================
@@ -66,10 +66,8 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
 * prototype only dealing with bullseye and amd64 (and arch all packages)
 ** 1st step: download a .buildinfo file and sbuild it - done
 ** 2nd step: random builder:
-*** find a package at random with grep-dctrl from the Packages file, this is about binary packages
-*** find .buildinfo files via builtin-pho, this is source based, however a source package can build an arch:all and arch:any binaries...
-*** rebuild all found .buildinfo files
-*** new result: NBIFA - no .buildinfo file available
+*** build a random .buildinfo file from builtin-pho
+**** fix the base distro problem (see NOPE in prototype.sh)
 ** 3rd step: put result in db in pb7
 ** 4th step: have some scheduler job and a rebuilder job picking up tasks
 *** scheduler on pb7
@@ -83,6 +81,7 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian
 ** table with these fields:
 *** src-pkg, binary-pkg, sha1 of .deb on ftp.d.o, sha1 of .buildinfo file (signed), sha1 of .buildinfo file (unsigned or signature stripped), signature type, name of .buildinfo file (from ftp.d.o)
 *** and either architecture of .deb or filename of .deb (as that includes the architecture)
+*** new result: NBIFA - no .buildinfo file available
 * another job to import data on jenkins (into postgresql)
 * schedule/trigger rebuilds on osuosl173, using data in postgresql|sqlite on pb7
 ** scheduler unclear, we'll first try to rebuild everthing in current sid (and bullseye and buster eventually) once, and then, once we've done this, we want to do this X times again. (and there will be ftbfs etc, not causing rebuilds immediatly.)


=====================================
bin/reproducible_debian_rebuilder_prototype.sh
=====================================
@@ -6,24 +6,24 @@
 
 cat << EOF
 
-###########################################################################################
-###											###
-### the goal is to create json export to integrate in tracker.d.o and/or packages.d.o	###
-###											###
-### another goal (implied in the one above) is create Debian's POV on the 'practical'	###
-### reproducibility status of the packages distributed via ftp.d.o. - so far		###
-### tests.r-b.o/debian/ only shows the 'theoretical' reproducibility of Debian packages.###
-###											###
-### we'll leave out the problem of 'trust' here quite entirely. that's why it's called	###
-### a Debian rebuilder 'thing', to explore technical feasibility, ductaping our way	###
-### ahead, keeping our motto 'to allow anyone to independently verify...' in mind.	###
-###											###
-###########################################################################################
+############################################################################################
+###											 ###
+### the goal is to create json export to integrate in tracker.d.o and/or packages.d.o	 ###
+###											 ###
+### another goal (implied in the one above) is to develop a 'real world' view about the  ###
+### reproducibility of the packages distributed via ftp.d.o. - so far tests.r-b.o/debian ###
+### only shows the 'theoretical' reproducibility of Debian packages.                     ###
+###											 ###
+### we'll leave out the problem of 'trust' here quite entirely. that's why it's called	 ###
+### a Debian rebuilder 'thing', to explore technical feasibility, duck taping our way	 ###
+### ahead, keeping our motto 'to allow anyone to independently verify...' in mind.	 ###
+###											 ###
+############################################################################################
 
 EOF
 
 
-DEBUG=true
+DEBUG=false
 . /srv/jenkins/bin/common-functions.sh
 common_init "$@"
 
@@ -51,7 +51,7 @@ set_poolpath() {
 #
 
 # query a random .buildinfo file path from builtin-pho db
-BUILTINPHOPATH=$(psql -A -t -c 'SELECT path FROM builds WHERE arch_amd64=true ORDER BR RANDOM() LIMIT 1 buildinfo')
+BUILTINPHOPATH=$(psql -A -t -c 'SELECT path FROM builds WHERE arch_amd64=true ORDER BR RANDOM() LIMIT 1' buildinfo)
 FILE="$(echo $BUILTINPHOPATH | cut -d '/' -f5-)"
 PKG="$(echo $FILE | cut -d '_' -f1)"
 VERSION="$(echo $FILE | cut -d '_' -f2)"



View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/cd281f708d1b0bfc0ed0b24e1ff85ec03c6099c1...c20e5480cff2eb30e045c25025b9273db0b7c8f5

-- 
View it on GitLab: https://salsa.debian.org/qa/jenkins.debian.net/-/compare/cd281f708d1b0bfc0ed0b24e1ff85ec03c6099c1...c20e5480cff2eb30e045c25025b9273db0b7c8f5
You're receiving this email because of your account on salsa.debian.org.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/qa-jenkins-scm/attachments/20200430/de4d0e8c/attachment-0001.html>