Bug#854084: binaryornot: Non-determistically FTBFS due to unreliable timing in tests

[Chris Lamb]

Source: binaryornot
Version: 0.4.0-1
Severity: serious
Justification: fails to build from source
User: reproducible-builds at lists.alioth.debian.org
Usertags: ftbfs
X-Debbugs-Cc: reproducible-bugs at lists.alioth.debian.org

Dear Maintainer,

binaryornot's testsuite appears to use method timing/benchmarking in
such a way that it will non-deterministically FTBFS:

  […]
  
  ======================================================================
  ERROR: test_never_crashes (tests.test_check.TestDetectionProperties)
  ----------------------------------------------------------------------
  Traceback (most recent call last):
    File "«BUILDDIR»/tests/test_check.py", line 180, in test_never_crashes
      def test_never_crashes(self, data):
    File "/usr/lib/python2.7/dist-packages/hypothesis/core.py", line 438, in wrapped_test
      HealthCheck.too_slow,
    File "/usr/lib/python2.7/dist-packages/hypothesis/core.py", line 306, in fail_health_check
      raise FailedHealthCheck(message)
  FailedHealthCheck: Data generation is extremely slow: Only produced 10 valid examples in 0.33 seconds (0 invalid ones and 1 exceeded maximum size). Try decreasing size of the data you're generating (with e.g.average_size or max_leaves parameters).
  See https://hypothesis.readthedocs.io/en/latest/healthchecks.html for more information about this. If you want to disable just this health check, add HealthCheck.too_slow to the suppress_health_check settings for this test.
  
  ----------------------------------------------------------------------
  Ran 43 tests in 0.557s
  
  FAILED (errors=1, expected failures=1)
  Test failed: <unittest.runner.TextTestResult run=43 errors=1 failures=0>
  error: Test failed: <unittest.runner.TextTestResult run=43 errors=1 failures=0>
  E: pybuild pybuild:283: test: plugin distutils failed with: exit code=1: python2.7 setup.py test 
  dh_auto_test: pybuild --test -i python{version} -p 2.7 returned exit code 13
  debian/rules:7: recipe for target 'build' failed
  make: *** [build] Error 25
  dpkg-buildpackage: error: debian/rules build gave error exit status 2

  […]

The full build log is attached.


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby at debian.org / chris-lamb.co.uk
       `-
-------------- next part --------------
A non-text attachment was scrubbed...
Name: binaryornot.0.4.0-1.unstable.amd64.log.txt.gz
Type: application/octet-stream
Size: 2833 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/reproducible-bugs/attachments/20170204/55da1e36/attachment.obj>