Bug#698611: please assure tests passing and do not ignore tests failure at package build time

[Anton Gladky]

Hi,

thanks for the bug-report. I will try to remove the suppressing
of auto-tests errors, disabling some of them. But the problem
can be in numerical instability, e.g. tests can fail stochastically and
it will be difficult to guess, which of them fail on build-servers and
which not.

Thanks,

Anton

2013/1/21 Yaroslav Halchenko <debian at onerussian.com>:
> Package: libgetfem4++
> Version: 4.2+dfsg1-1~exp2
> Severity: wishlist
>
> While testing effects of fixes in scipy I have sweeped through all reverse
> build-dependees to see if there are any regressions.  Unfortunately getfem4++
> package runs tests but swallows the error if such occurs, so such checks are
> non-effective
>
> override_dh_auto_test:
>         PYTHONPATH=$(CURDIR)/interface/src/python/ dh_auto_test || true
>
> so such failures as
>
> https://buildd.debian.org/status/fetch.php?pkg=getfem%2B%2B&arch=i386&ver=4.1.1%2Bdfsg1-11&stamp=1353199408
>
>     ============================================
>     |      An error has been detected !!!      |
>     ============================================
>     Error in ./gmm/gmm_MUMPS_interface.h, line 202 :
>     Solve with MUMPS failed: error -9, increase ICNTL(14)
>
>     FAIL: ../tests/nonlinear_elastostatic.pl
>
> might be passing unmentioned... current version in experimental also has
> some tests failing:
>
> https://buildd.debian.org/status/fetch.php?pkg=getfem%2B%2B&arch=i386&ver=4.2%2Bdfsg1-1~exp2&stamp=1353190392
>
>
>     PASS: ../tests/make_gmm_test.pl
>     ====================
>     3 of 38 tests failed
>     ====================
>
> IMHO (although it is a bit more work) it is better to explicitly handle those
> failures -- either provide fixes or disable them.
>
> Cheers
>
> -- System Information:
> Debian Release: 7.0
>   APT prefers testing
>   APT policy: (900, 'testing'), (600, 'unstable'), (300, 'experimental'), (100, 'stable')
> Architecture: amd64 (x86_64)
> Foreign Architectures: i386
>
> Kernel: Linux 3.2.0-4-amd64 (SMP w/2 CPU cores)
> Locale: LANG=en_US, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
> Shell: /bin/sh linked to /bin/bash
>
> Versions of packages libgetfem4++ depends on:
> ii  libatlas3-base [libblas.so.3gf]  3.8.4-9
> ii  libatlas3gf-base                 3.8.4-9
> ii  libblas3 [libblas3gf]            1.2.20110419-5
> ii  libblas3gf                       1.2.20110419-5
> ii  libc6                            2.13-37
> ii  libgcc1                          1:4.7.2-5
> pn  libmumps-seq-4.9.2               <none>
> ii  libmuparser0debian1              1.34-2
> ii  libqhull5                        2009.1-3
> ii  libstdc++6                       4.7.2-5
> pn  libsuperlu3                      <none>
>
> libgetfem4++ recommends no packages.
>
> libgetfem4++ suggests no packages.
>
> --
> debian-science-maintainers mailing list
> debian-science-maintainers at lists.alioth.debian.org
> http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/debian-science-maintainers