[PKG-Openstack-devel] Bug#834964: testresources: undeterministic test still runs and fails with probability 1/12

[Santiago Vila]

retitle 834964 testresources: undeterministic test still runs and fails with probability 1/12
thanks

On Fri, 9 Sep 2016, Thomas Goirand wrote:

> With an up-to-date Sid, I couldn't reproduce this issue. Therefore, I'm
> closing this bug. Feel free to continue discussing it even when it has
> the closed status if you want to continue investigating.

You already investigated this and tried to fix it.

The changelog reads like this:

testresources (1.0.0-1) unstable; urgency=medium

  * Do not run undeterministic test:
    - test_optimising_test_suite.TestGraphStuff.testBasicSortTests

and debian/rules reads like this:

ifeq (,$(filter nocheck,$(DEB_BUILD_OPTIONS)))
        nosetests -v --exclude=testresources.tests.test_optimising_test_suite.TestGraphStuff.testBasicSortTests
        nosetests3 -v --exclude=testresources.tests.test_optimising_test_suite.TestGraphStuff.testBasicSortTests
endif

So, there is a clear intention to disable the test because of it not
being deterministic (it fails approximately 1/12 of the time).

The only problem is that the way it's being disabled does not seem to
work, and the test still runs.

So, unless you disagree with yourself, this bug should be reopened and
the test should be really disabled.

Thanks.