Bug#979716: autopkgtest: networkd-test.py is flaky

[Michael Biebl]

Source: systemd
Version: 247.2-4
Severity: important
User: debian-ci at lists.debian.org
Usertags: flaky
X-Debbugs-Cc: debian-ci at lists.debian.org

It seems test/networkd-test.py is flaky.

Recent examples include
https://ci.debian.net/data/autopkgtest/testing/amd64/s/systemd/9526741/log.gz

This one failed with the following error:

======================================================================
ERROR: test_resolved_etc_hosts (__main__.DnsmasqClientTest)
resolved queries to /etc/hosts
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/tmp/autopkgtest-lxc.sj80w87n/downtmp/build.WPx/src/test/networkd-test.py", line 723, in test_resolved_etc_hosts
    out = subprocess.check_output(['resolvectl', 'query', 'other.example.com'])
  File "/usr/lib/python3.9/subprocess.py", line 420, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/lib/python3.9/subprocess.py", line 524, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['resolvectl', 'query', 'other.example.com']' returned non-zero exit status 1.

----------------------------------------------------------------------



https://ci.debian.net/data/autopkgtest/testing/amd64/s/systemd/9539306/log.gz
https://ci.debian.net/data/autopkgtest/testing/amd64/s/systemd/9506333/log.gz
https://ci.debian.net/data/autopkgtest/testing/amd64/s/systemd/9470937/log.gz

Those 3 failed with the following error:

======================================================================
FAIL: test_resolved_etc_hosts (__main__.DnsmasqClientTest)
resolved queries to /etc/hosts
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/tmp/autopkgtest-lxc.1gfzu6jm/downtmp/build.f4j/src/test/networkd-test.py", line 720, in test_resolved_etc_hosts
    self.assertIn(b'example.com IN MX 1 mail.example.com', out)
AssertionError: b'example.com IN MX 1 mail.example.com' not found in b'example.com IN MX 0                                         -- link: eth0\n\n-- Information acquired via protocol DNS in 2.9ms.\n-- Data is authenticated: no\n'

----------------------------------------------------------------------

I've seen networkd-test.py failures in the past, but the issue is not
easily reproducible.
I'm not entirely sure, whether it's the LXC/debci specific environment
which makes this more likely to trigger.





-- Package-specific info:

-- System Information:
Debian Release: bullseye/sid
  APT prefers unstable
  APT policy: (500, 'unstable'), (200, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 5.10.0-1-amd64 (SMP w/4 CPU threads)
Kernel taint flags: TAINT_FIRMWARE_WORKAROUND
Locale: LANG=de_DE.UTF-8, LC_CTYPE=de_DE.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages systemd is related to:
pn  dracut           <none>
ii  initramfs-tools  0.139
pn  libnss-systemd   <none>
ii  libpam-systemd   247.2-4
ii  udev             247.2-4

-- no debconf information