[Piuparts-devel] partially loaded Packages.xz caused massive log archival

[Andreas Beckmann]

Hi,

today I made an interesting observation with piuparts: piuparts-report 
had archived half of the jessie2stretch logs ... 
I think it loaded a partial Packages.xz for stretch (which didn't cause 
an error) and therefore classified the missing packages as target 
version "None".
Maybe we should limit the archiving to 1000 logs per section and 
piuparts-report run to limit the effect of such accidents.
No other section had shown similar problems.

It will be hard to test for such kind of a download error (or even
deliberately cause them) ... unless we verify signatures ...
If it happens in a piuparts test, it will fail and will be retried 
as a network issue. Just this time it hit piuparts-report

I probably only noticed this waiting for the postgresql logs being 
recycled to test the restart-before-cluster-upgrade bugfix, but got 
curious because all slaves were busy running jessie2stretch/main with 
18000 packages needing to be tested ... in a few days, everything would
have caught up again (and squid logs would be gone).
Reprocessing accelerated with 'ln -n archive/pass/*.log pass/' :-)


Andreas

PS: looking at the squid logs, it delivered several truncated 
Packages.xz files today

And there was also in /var/log/squid/cache.log

2017/12/14 11:57:45 kid1| Logfile: opening log stdio:/var/log/squid/netdb.state
2017/12/14 11:57:46 kid1| Logfile: closing log stdio:/var/log/squid/netdb.state
2017/12/14 11:57:46 kid1| NETDB state saved; 58 entries, 1955040 msec
2017/12/14 11:57:46 kid1| WARNING: Closing client connection due to lifetime timeout
2017/12/14 11:57:46 kid1|       http://ftp.de.debian.org/debian/pool/main/f/freerdp/libfreerdp-cache1.1_1.1.0%7egit20140921.1.440916e%2bdfsg1-13%2bdeb9u2_i386.deb
2017/12/14 11:57:46 kid1| WARNING: Closing client connection due to lifetime timeout
2017/12/14 11:57:46 kid1|       http://ftp.de.debian.org/debian/dists/stretch/main/binary-amd64/Packages.xz
2017/12/14 11:57:46 kid1| WARNING: Closing client connection due to lifetime timeout
2017/12/14 11:57:46 kid1|       http://ftp.de.debian.org/debian/dists/buster/main/binary-amd64/Packages.xz
2017/12/14 11:57:46 kid1| WARNING: Closing client connection due to lifetime timeout
2017/12/14 11:57:46 kid1|       http://ftp.de.debian.org/debian/dists/buster/main/binary-amd64/Packages.xz
2017/12/14 11:57:46 kid1| WARNING: Closing client connection due to lifetime timeout
2017/12/14 11:57:46 kid1|       http://ftp.de.debian.org/debian/dists/stretch/main/binary-amd64/Packages.xz
2017/12/14 11:57:46 kid1| WARNING: Closing client connection due to lifetime timeout
[...]

So either a network outage on my side or on the mirror side ...


Andreas