[DRE-maint] Bug#846021: ruby-webmock: FTBFS randomly (failing tests)

[Santiago Vila]

Package: src:ruby-webmock
Version: 1.22.6-1
Severity: serious

Dear maintainer:

I tried to build this package in stretch with "dpkg-buildpackage -A"
(which is what the "Arch: all" autobuilder would do to build it)
but it failed:

--------------------------------------------------------------------------------
[...]
 debian/rules build-indep
dh build-indep --buildsystem=ruby --with ruby
dh: Compatibility levels before 9 are deprecated (level 7 in use)
   dh_testdir -i -O--buildsystem=ruby
   dh_update_autotools_config -i -O--buildsystem=ruby
   dh_auto_configure -i -O--buildsystem=ruby
dh_auto_configure: Compatibility levels before 9 are deprecated (level 7 in use)
	dh_ruby --configure
   dh_auto_build -i -O--buildsystem=ruby
dh_auto_build: Compatibility levels before 9 are deprecated (level 7 in use)
	dh_ruby --build
   dh_ruby --build
   dh_auto_test -i -O--buildsystem=ruby

[... snipped ...]

┌──────────────────────────────────────────────────────────────────────────────┐
│ Run tests for ruby2.3 from debian/ruby-tests.rake                            │
└──────────────────────────────────────────────────────────────────────────────┘

RUBYLIB=/<<PKGBUILDDIR>>/debian/ruby-webmock/usr/lib/ruby/vendor_ruby:. GEM_PATH=debian/ruby-webmock/usr/share/rubygems-integration/all:/var/lib/gems/2.3.0:/usr/lib/x86_64-linux-gnu/rubygems-integration/2.3.0:/usr/share/rubygems-integration/2.3.0:/usr/share/rubygems-integration/all ruby2.3 -S rake -f debian/ruby-tests.rake
/usr/bin/ruby2.3 /usr/bin/rspec spec/acceptance/curb/curb_spec.rb spec/acceptance/em_http_request/em_http_request_spec.rb spec/acceptance/excon/excon_spec.rb spec/acceptance/http_rb/http_rb_spec.rb spec/acceptance/httpclient/httpclient_spec.rb spec/acceptance/manticore/manticore_spec.rb spec/acceptance/net_http/net_http_spec.rb spec/acceptance/net_http/real_net_http_spec.rb spec/acceptance/typhoeus/typhoeus_hydra_spec.rb spec/unit/api_spec.rb spec/unit/errors_spec.rb spec/unit/http_lib_adapters/http_lib_adapter_registry_spec.rb spec/unit/http_lib_adapters/http_lib_adapter_spec.rb spec/unit/matchers/hash_including_matcher_spec.rb spec/unit/rack_response_spec.rb spec/unit/request_body_diff_spec.rb spec/unit/request_execution_verifier_spec.rb spec/unit/request_pattern_spec.rb spec/unit/request_registry_spec.rb spec/unit/request_signature_snippet_spec.rb spec/unit/request_signature_spec.rb spec/unit/request_stub_spec.rb spec/unit/response_spec.rb spec/unit/stub_registry_spec.rb spec/unit/stub_request_snippet_spec.rb spec/unit/util/hash_counter_spec.rb spec/unit/util/hash_keys_stringifier_spec.rb spec/unit/util/headers_spec.rb spec/unit/util/json_spec.rb spec/unit/util/query_mapper_spec.rb spec/unit/util/uri_spec.rb spec/unit/util/version_checker_spec.rb spec/unit/webmock_spec.rb -c -f progress -r ./spec/spec_helper.rb
You are using Curb 0.9.3. WebMock is known to work with Curb >= 0.7.16, < 0.9. It may not work with this version.
No network connectivity. Only examples which do not make real network connections will run.
Run options:
  include {:focus=>true}
  exclude {:without_webmock=>true, :net_connect=>true}

All examples were filtered out; ignoring {:focus=>true}
..................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................F..................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................WebMock warning: ignoring query params in RFC 6570 template and checking them with WebMock
.WebMock warning: ignoring query params in RFC 6570 template and checking them with WebMock
.WebMock warning: ignoring query params in RFC 6570 template and checking them with WebMock
.WebMock warning: ignoring query params in RFC 6570 template and checking them with WebMock
.WebMock warning: ignoring query params in RFC 6570 template and checking them with WebMock
.WebMock warning: ignoring query params in RFC 6570 template and checking them with WebMock
......................................................................................................................................................................................................................................

Failures:

  1) HTTPClient when using async requests with WebMock when request stub declares that request should return a response when sequences of responses are declared should return responses one by one if declared with several to_return invokations
     Failure/Error: expect(http_request(:get, "http://www.example.com/").body).to eq("1")

       expected: "1"
            got: "2"

       (compared using ==)
     Shared Example Group: "declared responses" called from ./spec/acceptance/webmock_shared.rb:29
     Shared Example Group: "with WebMock" called from ./spec/acceptance/httpclient/httpclient_spec.rb:38
     # ./spec/acceptance/shared/returning_declared_responses.rb:300:in `block (4 levels) in <top (required)>'

Finished in 7.58 seconds (files took 2 minutes 11.5 seconds to load)
3232 examples, 1 failure

Failed examples:

rspec './spec/acceptance/httpclient/httpclient_spec.rb[1:4:1:6:15:4]' # HTTPClient when using async requests with WebMock when request stub declares that request should return a response when sequences of responses are declared should return responses one by one if declared with several to_return invokations

/usr/bin/ruby2.3 /usr/bin/rspec spec/acceptance/curb/curb_spec.rb spec/acceptance/em_http_request/em_http_request_spec.rb spec/acceptance/excon/excon_spec.rb spec/acceptance/http_rb/http_rb_spec.rb spec/acceptance/httpclient/httpclient_spec.rb spec/acceptance/manticore/manticore_spec.rb spec/acceptance/net_http/net_http_spec.rb spec/acceptance/net_http/real_net_http_spec.rb spec/acceptance/typhoeus/typhoeus_hydra_spec.rb spec/unit/api_spec.rb spec/unit/errors_spec.rb spec/unit/http_lib_adapters/http_lib_adapter_registry_spec.rb spec/unit/http_lib_adapters/http_lib_adapter_spec.rb spec/unit/matchers/hash_including_matcher_spec.rb spec/unit/rack_response_spec.rb spec/unit/request_body_diff_spec.rb spec/unit/request_execution_verifier_spec.rb spec/unit/request_pattern_spec.rb spec/unit/request_registry_spec.rb spec/unit/request_signature_snippet_spec.rb spec/unit/request_signature_spec.rb spec/unit/request_stub_spec.rb spec/unit/response_spec.rb spec/unit/stub_registry_spec.rb spec/unit/stub_request_snippet_spec.rb spec/unit/util/hash_counter_spec.rb spec/unit/util/hash_keys_stringifier_spec.rb spec/unit/util/headers_spec.rb spec/unit/util/json_spec.rb spec/unit/util/query_mapper_spec.rb spec/unit/util/uri_spec.rb spec/unit/util/version_checker_spec.rb spec/unit/webmock_spec.rb -c -f progress -r ./spec/spec_helper.rb failed
ERROR: Test "ruby2.3" failed. Exiting.
dh_auto_install: dh_ruby --install /<<PKGBUILDDIR>>/debian/ruby-webmock returned exit code 1
debian/rules:15: recipe for target 'binary-indep' failed
make: *** [binary-indep] Error 1
dpkg-buildpackage: error: fakeroot debian/rules binary-indep gave error exit status 2
--------------------------------------------------------------------------------

The relevant part of the build log is included above.

The failure happens randomly. Sometimes it fails, sometimes it does not.

A similar error may be found here:

https://tests.reproducible-builds.org/debian/rbuild/testing/amd64/ruby-webmock_1.22.6-1.rbuild.log

Thanks.