[Qa-jenkins-scm] Build failed in Jenkins: reproducible_fdroid_test #393

jenkins at jenkins.debian.net jenkins at jenkins.debian.net
Mon Dec 14 22:34:06 GMT 2020


See <https://jenkins.debian.net/job/reproducible_fdroid_test/393/display/redirect?page=changes>

Changes:

[hans] tests: include test http.server.log in the test's tmp dir

[hans] gitlab-ci: make `fdroid build` job actually build apps

[hans] tests: fix mirror test setup on macOS

[hans] release v2.0.a4


------------------------------------------
[...truncated 344.52 MB...]
org.videolan.vlc/en-US/phoneScreenshots/screenshot10.png
org.videolan.vlc/en-US/phoneScreenshots/screenshot12.png
org.videolan.vlc/en-US/phoneScreenshots/screenshot15.png
org.videolan.vlc/en-US/phoneScreenshots/screenshot18.png
org.videolan.vlc/en-US/phoneScreenshots/screenshot20.png
org.videolan.vlc/en-US/phoneScreenshots/screenshot22.png
org.videolan.vlc/en-US/phoneScreenshots/screenshot4.png
org.videolan.vlc/en-US/phoneScreenshots/screenshot7.png
org.videolan.vlc/en-US/phoneScreenshots/screenshot9.png
org.videolan.vlc/en-US/sevenInchScreenshots/
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot0.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot1.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot11.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot13.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot14.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot16.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot17.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot19.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot2.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot21.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot23.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot3.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot5.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot6.png
org.videolan.vlc/en-US/sevenInchScreenshots/screenshot8.png
status/
status/fakesubcommand.json
status/running.json
status/update.json

sent 3,360,704 bytes  received 3,487 bytes  6,728,382.00 bytes/sec
total size is 3,341,963  speedup is 0.99
2020-12-14 22:32:37,989 DEBUG: Popen(['git', 'init'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.nH9E/git-mirror, universal_newlines=False, shell=None)
2020-12-14 22:32:37,999 DEBUG: Popen(['git', 'remote', 'add', 'lib', '/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.dhjZ'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.nH9E/git-mirror, universal_newlines=False, shell=None)
2020-12-14 22:32:38,005 INFO: Mirroring to: /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.dhjZ
2020-12-14 22:32:38,005 DEBUG: Adding all files to git mirror
2020-12-14 22:32:38,005 DEBUG: Popen(['git', 'add', '--all'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.nH9E/git-mirror, universal_newlines=False, shell=None)
2020-12-14 22:32:38,186 DEBUG: Committing all files into git mirror
2020-12-14 22:32:38,210 DEBUG: Popen(['git', 'cat-file', '--batch-check'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.nH9E/git-mirror, universal_newlines=False, shell=None)
2020-12-14 22:32:38,215 DEBUG: Popen(['git', 'cat-file', '--batch'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.nH9E/git-mirror, universal_newlines=False, shell=None)
2020-12-14 22:32:38,224 DEBUG: Pushing to /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.dhjZ
2020-12-14 22:32:38,224 DEBUG: Popen(['git', 'version'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.nH9E/git-mirror, universal_newlines=False, shell=None)
2020-12-14 22:32:38,228 DEBUG: Popen(['git', 'push', '--force', '--porcelain', '--progress', '--set-upstream', 'lib', 'master'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.nH9E/git-mirror, universal_newlines=True, shell=None)
2020-12-14 22:32:38,691 DEBUG: /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.dhjZ: [new branch]

2020-12-14 22:32:38,693 INFO: Pushing binary transparency log to /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.O5CV
2020-12-14 22:32:38,693 DEBUG: Popen(['git', 'init'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.O5CV, universal_newlines=False, shell=None)
2020-12-14 22:32:38,703 DEBUG: Popen(['git', 'remote', 'add', 'local', '/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.nH9E/binary_transparency'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.O5CV, universal_newlines=False, shell=None)
2020-12-14 22:32:38,710 DEBUG: Popen(['git', 'pull', '-v', 'local', 'master'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.O5CV, universal_newlines=True, shell=None)
2020-12-14 22:32:38,759 DEBUG: Fetch head lines do not match lines provided via progress information
length of progress lines 2 should be equal to lines in FETCH_HEAD file 1
Will ignore extra progress lines or fetch head lines.
2020-12-14 22:32:38,762 DEBUG: Popen(['git', 'cat-file', '--batch-check'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps, universal_newlines=False, shell=None)
2020-12-14 22:32:38,768 DEBUG: Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps, universal_newlines=False, shell=None)
2020-12-14 22:32:38,775 DEBUG: Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps, universal_newlines=False, shell=None)
2020-12-14 22:32:38,785 DEBUG: skip deploying full build logs: not enabled in config
2020-12-14 22:32:38,786 DEBUG: skip deploying full build logs: not enabled in config
+ cd /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.O5CV
++ git rev-list --count HEAD
+ '[' 1 == 1 ']'
+ cd /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.dhjZ
++ git rev-list --count HEAD
+ '[' 1 == 1 ']'
==============================================================================
test extracting and publishing with developer signature
+ echo_header 'test extracting and publishing with developer signature'
++ create_test_dir
++ test -e /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles
++ mktemp -d /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.XXXX
+ REPOROOT=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.dAaR
+ cd /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.dAaR
+ fdroid_init_with_prebuilt_keystore
+ '[' -z '' ']'
+ keystore=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/tests/keystore.jks
+ /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroid init --keystore /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/tests/keystore.jks --repo-keyalias=sova
2020-12-14 22:32:39,257 WARNING: 
Using existing keystore "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/tests/keystore.jks"
Now set these in config.yml: keystorepass, keypass, keydname

2020-12-14 22:32:39,258 INFO: 
Built repo based in "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.dAaR" with this config:

  Android SDK:			/usr/lib/android-sdk
  Android NDK r12b (optional):	$ANDROID_NDK
  Keystore for signing key:	/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/tests/keystore.jks
  Alias for key in store:	sova

To complete the setup, add your APKs to "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.dAaR/repo"
then run "fdroid update -c; fdroid update".  You might also want to edit
"config.yml" to set the URL, repo name, and more.  You should also set up
a signing key (a temporary one might have been automatically generated).

For more info: https://f-droid.org/docs/Setup_an_F-Droid_App_Repo
and https://f-droid.org/docs/Signing_Process
+ echo 'keystorepass: r9aquRHYoI8+dYz6jKrLntQ5/NJNASFBacJh7Jv2BlI='
+ echo 'keypass: r9aquRHYoI8+dYz6jKrLntQ5/NJNASFBacJh7Jv2BlI='
+ echo 'keydname: "CN=Birdman, OU=Cell, O=Alcatraz, L=Alcatraz, S=California, C=US"'
+ test -d metadata
+ mkdir metadata
+ cp /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/tests/metadata/com.politedroid.yml metadata/
+ test -d repo
+ test -d unsigned
+ mkdir unsigned
+ cp /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/tests/repo/com.politedroid_6.apk unsigned/
+ /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroid signatures unsigned/com.politedroid_6.apk
2020-12-14 22:32:40,242 INFO: Fetched signatures for 'unsigned/com.politedroid_6.apk' -> 'metadata/com.politedroid/signatures/6'
+ test -d metadata/com.politedroid/signatures/6
+ test -f metadata/com.politedroid/signatures/6/MANIFEST.MF
+ test -f metadata/com.politedroid/signatures/6/RELEASE.RSA
+ test -f metadata/com.politedroid/signatures/6/RELEASE.SF
+ test -f repo/com.politedroid_6.apk
+ /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroid publish
2020-12-14 22:32:40,597 INFO: Creating log directory
2020-12-14 22:32:40,598 INFO: 1 app, 1 key aliases
2020-12-14 22:32:40,599 INFO: Processing unsigned/com.politedroid_6.apk
2020-12-14 22:32:41,406 INFO: Key alias: 4e7da5b7
2020-12-14 22:32:42,903 INFO: Published com.politedroid_6.apk
2020-12-14 22:32:44,251 INFO: published list signing-key fingerprints
+ test -f repo/com.politedroid_6.apk
+ which jarsigner
/usr/bin/jarsigner
+ jarsigner -verify repo/com.politedroid_6.apk

jar verified.

Warning: 
This jar contains entries whose certificate chain is invalid. Reason: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
This jar contains entries whose signer certificate is self-signed.
The SHA1 digest algorithm is considered a security risk. This algorithm will be disabled in a future update.
The SHA1withRSA signature algorithm is considered a security risk. This algorithm will be disabled in a future update.
This jar contains signatures that do not include a timestamp. Without a timestamp, users may not be able to validate this jar after any of the signer certificates expire (as early as 2041-11-08).

Re-run with the -verbose and -certs options for more details.
/usr/bin/apksigner
+ which apksigner
+ apksigner verify repo/com.politedroid_6.apk
+ echo_header 'test mirroring a repo'
==============================================================================
test mirroring a repo
+ which wget
/usr/bin/wget
++ create_test_dir
++ test -e /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles
++ mktemp -d /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.XXXX
+ REPOROOT=/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.F3O5
+ cd /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/tests
+ test -d archive
+ mkdir archive
+ cp repo/index-v1.json /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.F3O5/
+ /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroid signindex
2020-12-14 22:32:45,820 WARNING: config.py is deprecated, use config.yml
2020-12-14 22:32:46,532 INFO: Signed repo/index-v1.json
+ mv /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.F3O5/index-v1.json repo/index-v1.json
+ port=321098
++ printf 321098
++ wc --chars
+ test 6 -le 3
+ http_server_pid=25897
+ cd /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/.testfiles/run-tests.F3O5
+ timeout 5m python3 -m http.server 321098 --bind 127.0.0.1
+ http_proxy=
+ HTTP_PROXY=
+ /var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroid mirror http://127.0.0.1:321098/
2020-12-14 22:32:46,996 WARNING: http://127.0.0.1:321098/ does not end with "fdroid", check the URL path!
2020-12-14 22:32:46,999 CRITICAL: Unknown exception found!
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 159, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw)
  File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 80, in create_connection
    raise err
  File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 70, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.7/http/client.py", line 1244, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.7/http/client.py", line 1290, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.7/http/client.py", line 1239, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.7/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.7/http/client.py", line 966, in send
    self.connect()
  File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 181, in connect
    conn = self._new_conn()
  File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 168, in _new_conn
    self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fa74e692208>: Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 398, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='127.0.0.1', port=321098): Max retries exceeded with url: /repo/index-v1.jar (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa74e692208>: Failed to establish a new connection: [Errno 111] Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroid", line 22, in <module>
    fdroidserver.__main__.main()
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroidserver/__main__.py", line 227, in main
    raise e
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroidserver/__main__.py", line 208, in main
    mod.main()
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroidserver/mirror.py", line 143, in main
    data, etag, index_url = _get_index(section)
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroidserver/mirror.py", line 99, in _get_index
    content, etag = net.http_get(url)
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroidserver/net.py", line 60, in http_get
    r = requests.get(url, headers=HEADERS, timeout=timeout)
  File "/usr/lib/python3/dist-packages/requests/api.py", line 75, in get
    return request('get', url, params=params, **kwargs)
  File "/usr/lib/python3/dist-packages/requests/api.py", line 60, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/lib/python3/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/lib/python3/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/lib/python3/dist-packages/requests/adapters.py", line 516, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='127.0.0.1', port=321098): Max retries exceeded with url: /repo/index-v1.jar (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa74e692208>: Failed to establish a new connection: [Errno 111] Connection refused'))
+ cleanup_all
+ set +e
++ date -u
Mon 14 Dec 2020 10:32:47 PM UTC - cleanup in progress...
+ echo 'Mon 14 Dec 2020 10:32:47 PM UTC - cleanup in progress...'
Mon 14 Dec 2020 10:32:47 PM UTC - cleanup done.
Mon 14 Dec 2020 10:32:47 PM UTC - reproducible_fdroid_test.sh stopped running as /tmp/jenkins-script-gISERIlh, which will now be removed.
+ killall adb
adb: no process found
+ killall gpg-agent
++ date -u
+ echo 'Mon 14 Dec 2020 10:32:47 PM UTC - cleanup done.'

SSH EXIT CODE: 1
Build step 'Execute shell' marked build as failure



More information about the Qa-jenkins-scm mailing list