[Piuparts-devel] Pejacevik backlog

[Nicolas Dandrimont]

* Holger Levsen <holger at layer-acht.org> [2020-02-21 14:10:28 +0000]:

> On Fri, Feb 21, 2020 at 08:35:10AM -0500, Dave Steele wrote:
> > I was shut in yesterday, bored, and curious about [this plot], so I made a
> > [backlog chart] for pejacevik.
> > 
> > [this plot]: https://piuparts.debian.org/oldstable222sid/states.png
> > [backlog chart]:
> > https://docs.google.com/spreadsheets/d/1bvBge2GId6MiB9fztVtj-AY_5vb-IWwNxGcHbFA6X1E
> 
> wow, nice work.

Yeah, thanks for that.

How did you generate this? Would it be possible to do that on pejacevic directly?

> fixing #948456 would address this...

For now, I don't want to request more resources from DSA until I get a better
feel of how piuparts.d.o is actually running. I'm still not convinced the
current state warrants it (and I'd like to have numbers to present to be sure
of it).

I'd like to add more introspection into the scheduling mechanism. For that, I
think I want to make the scheduler a separate component (it's really
entangled with the master code currently, which makes simple things such as
getting the "queue state" from the outside harder than it should be).

Overall, I'm not convinced that the current mechanism where we have trusted
slaves that pull jobs from the master is that good; turning it the other way
around would make it easier to spin new workers up/down when the load spikes.
But for now that's just a gut feeling.

I've been (slowly) getting more comfortable with things, but it takes a while
(and I'd like to avoid breaking migration to testing while I'm poking stuff).

I'd like to pick Dave's work up as a step in the right direction, if it's
possible integrate it to piuparts.d.o; if you squint at it the right way, the
general trend is not as bad as it feels (when the runner doesn't just stop
running for a few days).

Cheers,
-- 
Nicolas Dandrimont

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://alioth-lists.debian.net/pipermail/piuparts-devel/attachments/20200221/c86a9ef5/attachment.sig>