Bug#1025908: systemd: flaky autopkgtest: test_resolved_domain_restricted_dns

[Paul Gevers]

Source: systemd
Version: 251.4-3
Severity: serious
User: debian-ci at lists.debian.org
Usertags: flaky

Dear maintainer(s),

I looked at the results of the autopkgtest of your package. I noticed 
that it regularly fails. It seems that DNS either times out or isn't 
really reliable. I suggest to either increase the timeout (if that's the 
cause, skip the test, or make it retry at least once.

Because the unstable-to-testing migration software now blocks on
regressions in testing, flaky tests, i.e. tests that flip between
passing and failing without changes to the list of installed packages,
are causing people unrelated to your package to spend time on these
tests.

Don't hesitate to reach out if you need help and some more information
from our infrastructure.

Paul

https://ci.debian.net/data/autopkgtest/testing/i386/s/systemd/29214658/log.gz

======================================================================
ERROR: test_resolved_domain_restricted_dns (__main__.DnsmasqClientTest)
resolved: domain-restricted DNS servers
----------------------------------------------------------------------
Traceback (most recent call last):
    File 
"/tmp/autopkgtest-lxc.45d4ds2y/downtmp/build.g5f/src/test/networkd-test.py", 
line 686, in test_resolved_domain_restricted_dns
      out = subprocess.check_output(['resolvectl', 'query', 
'search.example.com'])
    File "/usr/lib/python3.10/subprocess.py", line 421, in check_output
      return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
    File "/usr/lib/python3.10/subprocess.py", line 526, in run
      raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['resolvectl', 'query', 
'search.example.com']' returned non-zero exit status 1.

----------------------------------------------------------------------


https://ci.debian.net/data/autopkgtest/testing/amd64/s/systemd/29160541/log.gz

======================================================================
ERROR: test_resolved_domain_restricted_dns (__main__.DnsmasqClientTest)
resolved: domain-restricted DNS servers
----------------------------------------------------------------------
Traceback (most recent call last):
    File 
"/tmp/autopkgtest-lxc.65kf3irc/downtmp/build.HiP/src/test/networkd-test.py", 
line 686, in test_resolved_domain_restricted_dns
      out = subprocess.check_output(['resolvectl', 'query', 
'search.example.com'])
    File "/usr/lib/python3.10/subprocess.py", line 421, in check_output
      return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
    File "/usr/lib/python3.10/subprocess.py", line 526, in run
      raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['resolvectl', 'query', 
'search.example.com']' returned non-zero exit status 1.



-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_signature
Type: application/pgp-signature
Size: 495 bytes
Desc: OpenPGP digital signature
URL: <http://alioth-lists.debian.net/pipermail/pkg-systemd-maintainers/attachments/20221211/4fefcfa2/attachment.sig>