Bug#970864: dolphinx: flaky amd64 autopkgtest on ci.debian.net: regularly times out

[Paul Gevers]

Source: dolfinx
Version: 2019.2.0~git20200420.6043d6d-6
Severity: serious
Tags: sid bullseye
X-Debbugs-CC: debian-ci at lists.debian.org
User: debian-ci at lists.debian.org
Usertags: flaky timesout

Dear maintainer(s),

The autopkgtest of dolphinx turns up on the ci.debian.net slow test page
[1]. That's not a problem per se, but your test regularly times out and
fails, while other times it finishes and passes.

Within autopkgtest, there are different timeouts involved (see
autopkgtest(1)), in the case of this package the timeout that is hit is
the per test timeout.

Because the unstable-to-testing migration software now blocks on
regressions in testing, flaky tests, i.e. tests that flip between
passing and failing without changes to the list of installed packages,
are causing people unrelated to your package to spend time on these
tests.

I copied the output of one of the failures at the bottom of this report.

Please do get in touch if we need to dive into this together.

Paul

[1] https://ci.debian.net/status/slow/

https://ci.debian.net/data/autopkgtest/testing/amd64/d/dolfinx/7160784/log.gz

python/test/unit/fem/test_expression_evaluation.py
python/test/unit/fem/test_expression_evaluation.py
       [ 32%]
python/test/unit/fem/test_expression_evaluation.py xxx
   [ 33%]                     [ 33%]
python/test/unit/fem/test_fem_pipeline.py                      [ 33%]
python/test/unit/fem/test_fem_pipeline.py
python/test/unit/fem/test_fem_pipeline.py
.....................................................................autopkgtest
[07:10:36]: ERROR: timed out on command "su -s /bin/bash debci -c set
-e; export USER=`id -nu`; . /etc/profile >/dev/null 2>&1 || true;  .
~/.profile >/dev/null 2>&1 || true;
buildtree="/tmp/autopkgtest-lxc.lgrg6l15/downtmp/build.lxi/src"; mkdir
-p -m 1777 --
"/tmp/autopkgtest-lxc.lgrg6l15/downtmp/test-dolfinx-python-complex-artifacts";
export
AUTOPKGTEST_ARTIFACTS="/tmp/autopkgtest-lxc.lgrg6l15/downtmp/test-dolfinx-python-complex-artifacts";
export ADT_ARTIFACTS="$AUTOPKGTEST_ARTIFACTS"; mkdir -p -m 755
"/tmp/autopkgtest-lxc.lgrg6l15/downtmp/autopkgtest_tmp"; export
AUTOPKGTEST_TMP="/tmp/autopkgtest-lxc.lgrg6l15/downtmp/autopkgtest_tmp";
export ADTTMP="$AUTOPKGTEST_TMP"; export DEBIAN_FRONTEND=noninteractive;
export LANG=C.UTF-8; export DEB_BUILD_OPTIONS=parallel=2; unset LANGUAGE
LC_CTYPE LC_NUMERIC LC_TIME LC_COLLATE   LC_MONETARY LC_MESSAGES
LC_PAPER LC_NAME LC_ADDRESS   LC_TELEPHONE LC_MEASUREMENT
LC_IDENTIFICATION LC_ALL;rm -f /tmp/autopkgtest_script_pid; set -C; echo
$$ > /tmp/autopkgtest_script_pid; set +C; trap "rm -f
/tmp/autopkgtest_script_pid" EXIT INT QUIT PIPE; cd "$buildtree"; chmod
+x
/tmp/autopkgtest-lxc.lgrg6l15/downtmp/build.lxi/src/debian/tests/test-dolfinx-python-complex;
touch
/tmp/autopkgtest-lxc.lgrg6l15/downtmp/test-dolfinx-python-complex-stdout
/tmp/autopkgtest-lxc.lgrg6l15/downtmp/test-dolfinx-python-complex-stderr; /tmp/autopkgtest-lxc.lgrg6l15/downtmp/build.lxi/src/debian/tests/test-dolfinx-python-complex
2> >(tee -a
/tmp/autopkgtest-lxc.lgrg6l15/downtmp/test-dolfinx-python-complex-stderr
>&2) > >(tee -a
/tmp/autopkgtest-lxc.lgrg6l15/downtmp/test-dolfinx-python-complex-stdout);"
(kind: test)
autopkgtest [07:10:44]: test test-dolfinx-python-complex:
-----------------------]

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 488 bytes
Desc: OpenPGP digital signature
URL: <http://alioth-lists.debian.net/pipermail/debian-science-maintainers/attachments/20200924/4e834ca7/attachment.sig>