[Piuparts-devel] partially loaded Packages.xz caused massive log archival

[Holger Levsen]

On Fri, Dec 15, 2017 at 12:05:01AM +0100, Andreas Beckmann wrote:
> today I made an interesting observation with piuparts: piuparts-report 
> had archived half of the jessie2stretch logs ... 
> I think it loaded a partial Packages.xz for stretch (which didn't cause 
> an error) and therefore classified the missing packages as target 
> version "None".

ouch.

> Maybe we should limit the archiving to 1000 logs per section and 
> piuparts-report run to limit the effect of such accidents.
> No other section had shown similar problems.

seems sensible, probably even just 100 logs per section should be
plenty.

> It will be hard to test for such kind of a download error (or even
> deliberately cause them) ... unless we verify signatures ...

I guess we should do that.

> If it happens in a piuparts test, it will fail and will be retried 
> as a network issue. Just this time it hit piuparts-report
> 
> I probably only noticed this waiting for the postgresql logs being 
> recycled to test the restart-before-cluster-upgrade bugfix, but got 
> curious because all slaves were busy running jessie2stretch/main with 
> 18000 packages needing to be tested ... in a few days, everything would
> have caught up again (and squid logs would be gone).

oh dear…

> So either a network outage on my side or on the mirror side ...

both are definitly likely to happen once in a while… so we should deal
with those gracefully.


-- 
cheers,
	Holger
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/piuparts-devel/attachments/20171215/e797520d/attachment.sig>