[Piuparts-devel] splitting up the daily processing to allow concurrency

Andreas Beckmann anbe at debian.org
Wed Oct 4 04:23:27 UTC 2017


012b49748 p: run post_chroot_unpack scripts before initial apt-get update
63274cd09 lib/db: Package: add and use accessors name(), version(), test_versions()
b520e68e7 lib/db: Package: set test_versions to the version in the final distro
d8943b7b6 p-r: acquire a global "report.lock"
792b55edf p-r: aquire master.lock for the current section (blocking)
d4cb06116 dwke: acquire a global "dwke.lock"
75c700236 dwke: acquire master.lock for the current section (blocking)
5341f2c94 p-a: aquire master.lock for the current section (blocking)
20f199a18 p-a: process all sections
59934f316 split up the generate_daily_report cronjob
6a0360c61 remove master-bin/report_newly_bugged_packages

there is more in the queue for it (postponing busy sections
instead of blocking) but this for a start should speed up daily
processing

I'm running dwke every three hours s.t. the backlog of new logs
hopefully doesn't get too large and trying piuparts-report every
three hours as well s.t. we get as many runs done per day as
possible (hopefully again 3-4)


Andreas



More information about the Piuparts-devel mailing list