Bug#1147995: systemd: ci containers time out after upgrading systemd in testbed

[Paul Gevers]

Source: systemd
Version: 262~rc2-1

Hi,

We're currently seeing a lot of tmpfails on ci.debian.net. It turns out 
that each testbed that upgrades binaries from systemd during it's 
preparation step and ordering a reboot fails to return. (I'd put this 
bug at severity serious if I had better info, but filing already to 
kickstart discussion).

To reproduce I ran the following command, which only updates systemd 
binaries from unstable in the testing testbed:
autopkgtest -ddd --setup-commands="echo" --apt-upgrade 
--no-built-binaries  --timeout=30600 
--pin-packages=unstable=src:systemd --add-apt-source='deb 
http://deb.debian.org/debian unstable main' hello -- incus 
autopkgtest/debian/testing/amd64 -- --storage tmpfs

I note two lines that worry me a bit, but they may be red harrings:
1) Can't exec "kill": No such file or directory at 
/usr/bin/deb-systemd-invoke line 179.
2) Could not execute systemctl:  at /usr/bin/deb-systemd-invoke line 148.

Paul

The log fails with:
Unpacking libsystemd0:amd64 (262~rc2-1) over (261.2-1) ...
Setting up libsystemd0:amd64 (262~rc2-1) ...
(Reading database ... 10013 files and directories currently installed.)
Preparing to unpack .../libudev1_262~rc2-1_amd64.deb ...
Unpacking libudev1:amd64 (262~rc2-1) over (261.2-1) ...
Setting up libudev1:amd64 (262~rc2-1) ...
Setting up systemd (262~rc2-1) ...
Can't exec "kill": No such file or directory at 
/usr/bin/deb-systemd-invoke line 179.
Job for systemd-journald.service failed because the control process 
exited with error code.
See "systemctl status systemd-journald.service" and "journalctl -xeu 
systemd-journald.service" for details.
Job for systemd-networkd.service failed because the control process 
exited with error code.
See "systemctl status systemd-networkd.service" and "journalctl -xeu 
systemd-networkd.service" for details.
Setting up systemd-resolved (262~rc2-1) ...
Could not execute systemctl:  at /usr/bin/deb-systemd-invoke line 148.
Setting up systemd-sysv (262~rc2-1) ...
Processing triggers for dbus (1.16.2-5+b1) ...
Processing triggers for libc-bin (2.43-5) ...
autopkgtest: DBG: testbed command exited with code 0
autopkgtest: DBG: testbed command ['/bin/sh', '-ec', '"$@" 3>&2 2>&1', 
'run_apt_command', 'apt-get', '--quiet', '--assume-yes', 
'-o=APT::Status-Fd=3', '-o=APT::Install-Recommends=false', 
'-o=DPkg::Lock::Timeout=300', '-o=Dpkg::Options::=--force-confnew', 
'-o=Debug::pkgProblemResolver=true', '--purge', 'autoremove'], kind 
install, sout raw, serr pipe, env ['DEBIAN_FRONTEND=noninteractive', 
'APT_LISTBUGS_FRONTEND=none', 'APT_LISTCHANGES_FRONTEND=none']
Reading package lists...
Building dependency tree...
Reading state information...
Solving dependencies...
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
autopkgtest: DBG: testbed command exited with code 0
autopkgtest: DBG: testbed command ['bash', '-ec', '[ ! -e 
/run/autopkgtest_no_reboot.stamp ] || exit 0;for d in /boot /boot/efi 
/boot/grub /etc/init /etc/init.d /etc/systemd/system 
/lib/systemd/system; do s=/tmp/autopkgtest.d5pcqe/${d//\\//_}.stamp;  [ 
! -d $d ] || [ `stat -c %Y $d` = `stat -c %Y $s` ]; done'], kind short, 
sout raw, serr raw, env []
autopkgtest: DBG: testbed command exited with code 1
autopkgtest [20:11:11]: rebooting testbed after setup commands that 
affected boot
autopkgtest: DBG: sending command to virtualisation server: reboot
<VirtSubproc>: failure: timed out waiting for instance 
local:autopkgtest-incus-pgtacr to restart
autopkgtest: DBG: sending command to virtualisation server: 
auxverb_debug_fail
autopkgtest: DBG: TestbedFailure cannot send to virtualisation server: 
[Errno 32] Broken pipe
autopkgtest: DBG: auxverb_debug_fail failed: cannot send to 
virtualisation server: [Errno 32] Broken pipe
autopkgtest: DBG: TestbedFailure eof from the virtualisation server
autopkgtest [20:12:54]: ERROR: testbed failure: eof from the 
virtualisation server
autopkgtest: DBG: testbed stop
autopkgtest: DBG: testbed close, scratch=/tmp/autopkgtest.d5pcqe
autopkgtest: DBG: sending command to virtualisation server: close
autopkgtest: DBG: TestbedFailure cannot send to virtualisation server: 
[Errno 32] Broken pipe
Exception ignored in: <_io.TextIOWrapper name=5 encoding='UTF-8'>
BrokenPipeError: [Errno 32] Broken pipe


-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_signature.asc
Type: application/pgp-signature
Size: 585 bytes
Desc: OpenPGP digital signature
URL: <http://alioth-lists.debian.net/pipermail/pkg-systemd-maintainers/attachments/20260915/f118695b/attachment.sig>