Bug#698611: please assure tests passing and do not ignore tests failure at package build time

[Yaroslav Halchenko]

Package: libgetfem4++
Version: 4.2+dfsg1-1~exp2
Severity: wishlist

While testing effects of fixes in scipy I have sweeped through all reverse
build-dependees to see if there are any regressions.  Unfortunately getfem4++
package runs tests but swallows the error if such occurs, so such checks are
non-effective

override_dh_auto_test:
        PYTHONPATH=$(CURDIR)/interface/src/python/ dh_auto_test || true

so such failures as

https://buildd.debian.org/status/fetch.php?pkg=getfem%2B%2B&arch=i386&ver=4.1.1%2Bdfsg1-11&stamp=1353199408

    ============================================
    |      An error has been detected !!!      |
    ============================================
    Error in ./gmm/gmm_MUMPS_interface.h, line 202 : 
    Solve with MUMPS failed: error -9, increase ICNTL(14)

    FAIL: ../tests/nonlinear_elastostatic.pl

might be passing unmentioned... current version in experimental also has
some tests failing:

https://buildd.debian.org/status/fetch.php?pkg=getfem%2B%2B&arch=i386&ver=4.2%2Bdfsg1-1~exp2&stamp=1353190392


    PASS: ../tests/make_gmm_test.pl
    ====================
    3 of 38 tests failed
    ====================

IMHO (although it is a bit more work) it is better to explicitly handle those
failures -- either provide fixes or disable them.

Cheers

-- System Information:
Debian Release: 7.0
  APT prefers testing
  APT policy: (900, 'testing'), (600, 'unstable'), (300, 'experimental'), (100, 'stable')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 3.2.0-4-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_US, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash

Versions of packages libgetfem4++ depends on:
ii  libatlas3-base [libblas.so.3gf]  3.8.4-9
ii  libatlas3gf-base                 3.8.4-9
ii  libblas3 [libblas3gf]            1.2.20110419-5
ii  libblas3gf                       1.2.20110419-5
ii  libc6                            2.13-37
ii  libgcc1                          1:4.7.2-5
pn  libmumps-seq-4.9.2               <none>
ii  libmuparser0debian1              1.34-2
ii  libqhull5                        2009.1-3
ii  libstdc++6                       4.7.2-5
pn  libsuperlu3                      <none>

libgetfem4++ recommends no packages.

libgetfem4++ suggests no packages.