[Piuparts-devel] splitting up the daily processing to allow concurrency

[Holger Levsen]

On Wed, Oct 04, 2017 at 06:23:27AM +0200, Andreas Beckmann wrote:
> 012b49748 p: run post_chroot_unpack scripts before initial apt-get update
> 63274cd09 lib/db: Package: add and use accessors name(), version(), test_versions()
> b520e68e7 lib/db: Package: set test_versions to the version in the final distro
> d8943b7b6 p-r: acquire a global "report.lock"
> 792b55edf p-r: aquire master.lock for the current section (blocking)
> d4cb06116 dwke: acquire a global "dwke.lock"
> 75c700236 dwke: acquire master.lock for the current section (blocking)
> 5341f2c94 p-a: aquire master.lock for the current section (blocking)
> 20f199a18 p-a: process all sections
> 59934f316 split up the generate_daily_report cronjob
> 6a0360c61 remove master-bin/report_newly_bugged_packages

I'm loving it, but I would like to release 0.81 first, to fix user facing bugs
in sid. So to repeat my question from last night: is there anything in the
develop branch right now which is missing a changelog entry?
 
> there is more in the queue for it (postponing busy sections
> instead of blocking) but this for a start should speed up daily
> processing
> 
> I'm running dwke every three hours s.t. the backlog of new logs
> hopefully doesn't get too large and trying piuparts-report every
> three hours as well s.t. we get as many runs done per day as
> possible (hopefully again 3-4)

cool!


-- 
cheers,
	Holger
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/piuparts-devel/attachments/20171004/ca8e9cb6/attachment-0001.sig>