[pkg-netfilter-team] Bug#903083: nftables: autopkgtest reports lots of errors but still passes

[Paul Gevers]

Source: nftables
Version: 0.9.0-1
Severity: normal
User: debian-ci at lists.debian.org
Usertags: issue

Dear maintainer,

I just spotted the log of the autopkgtest of nftables. It currently
passes but the log says it fails. E.g. internaltest-shell.sh ends with
the message copied below. It says that 20 tests FAILED.

If you want your test to be useful apart from manual inspection I
suggest you fix your autopkgtest to exit with non-zero value if errors
occur.

Paul

https://ci.debian.net/data/autopkgtest/testing/amd64/n/nftables/560295/log.gz

W: [FAILED]	././testcases/transactions/0040set_0: expected 0 but
got 1
/dev/stdin:2:1-29: Error: Could not process rule: Device or resource busy
delete chain ip filter CIn_1
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
I: [EXECUTING]	././testcases/transactions/0041nat_restore_0
I: [OK]		././testcases/transactions/0041nat_restore_0

I: results: [OK] 138 [FAILED] 20 [TOTAL] 158

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 488 bytes
Desc: OpenPGP digital signature
URL: <http://alioth-lists.debian.net/pipermail/pkg-netfilter-team/attachments/20180705/cee5feff/attachment.sig>