[Pkg-pascal-devel] Bug#956956: lazarus: flaky autopkgtest on arm64: EAccessViolation, EInOutError

[Simon McVittie]

Source: lazarus
Version: 2.0.6+dfsg-3
Severity: serious
Tags: sid bullseye
X-Debbugs-CC: debian-ci at lists.debian.org
User: debian-ci at lists.debian.org
Usertags: flaky

The lazarus autopkgtest seems to pass reliably on amd64, but fails with an
access violation (NULL pointer dereference?) or an "Invalid file handle"
error about half the time on arm64.

Because the unstable-to-testing migration software now blocks on
regressions in testing, flaky tests, i.e. tests that flip between
passing and failing without changes to the list of installed packages,
are causing people unrelated to your package to spend time on these
tests. Please either fix the test to be more robust, or or use the
"flaky" restriction for the offending test until a solution has been found.

Because this test seems to be reliable on amd64, another option might be
to mark the test with the "skippable" restriction, and make it exit 77
if there's a crash on arm64 (but I'm not sure how that interacts with
detecting test failures via output on stderr).

https://ci.debian.net/data/autopkgtest/testing/arm64/l/lazarus/5007737/log.gz
is a typical example, which shows both failure modes (full log attached).
The stderr is:

autopkgtest [03:54:00]: test build-lpk-lpi:  - - - - - - - - - - stderr - - - - - - - - - -
An unhandled exception occurred at $0000AAAAE9A147A0:
EInOutError: Invalid file handle
  $0000AAAAE9A147A0
  $0000AAAAE9B17D8C
  $0000AAAAE9A0B658
  $0000AAAAE9A6E714
  $0000AAAAE9B15E70
  $0000AAAAEA03E464
  $0000AAAAE9B247F4
  $0000AAAAE9A0B658
  $0000AAAAE9B16094
  $0000AAAAE9B163A4
  $0000AAAAE9B82690
  $0000AAAAE9B825A8
  $0000AAAAE9A0B658
  $0000AAAAE9C68A48
  $0000AAAAE9A2F454
  $0000AAAAE9A2F3E0
  $0000AAAAE9A2F008

An unhandled exception occurred at $0000000000000000:
EAccessViolation: Access violation
  $0000000000000000

An unhandled exception occurred at $0000000000000000:
EAccessViolation: Access violation
  $0000000000000000

Some other recent test failures:
https://ci.debian.net/data/autopkgtest/testing/arm64/l/lazarus/4879692/log.gz
https://ci.debian.net/data/autopkgtest/testing/arm64/l/lazarus/4630413/log.gz
https://ci.debian.net/data/autopkgtest/testing/arm64/l/lazarus/4381462/log.gz

Thanks,
    smcv
-------------- next part --------------
A non-text attachment was scrubbed...
Name: log.gz
Type: application/gzip
Size: 155482 bytes
Desc: not available
URL: <http://alioth-lists.debian.net/pipermail/pkg-pascal-devel/attachments/20200417/7176675f/attachment-0001.gz>