[DRE-maint] Bug#894272: gitlab: Problem on upgrade from 8.13 - 9.5 - 10.5. Probably local setup problem
David L
er_maqui at darkbolt.net
Wed Mar 28 01:33:21 UTC 2018
Package: gitlab
Version: 10.5.6+dfsg-1
Severity: normal
Hi,
I have a gitlab installation working originally on 8.13 version.
This installation stop working when some upgrades for 9.5 enters testing.
I have the same failure from my test installation, some gems installed locally.
History are:
I've upgrade 8.13 to 9.5.4+dfsg-7. Not working because sprockets problem.
I've upgrade 9.5.4 to 10.5.5+dfsg-3. Not working because sprockets problem.
I've done a full backup of installation and database, deleted all locally installed gems, apt-get remove gitlab && apt-get remove ruby && purge gitlab && apt-get install gitlab.
As I've detected, on some cases, purge fails because there's some process running as gitlab user.
My problem:
After a full delete of gitlab & ruby and another dependences, I've do a clean install (without restore any backup yet).
Gitlab installs correctly, but, there's a problem starting sidekiq. There's the log:
Child worker:
Asset Size Chunks Chunk Names
c3789bfe47e4e75a43bd.worker.js 188 kB main [emitted] main
[../../../../../../var/lib/gitlab/.node_modules/diff/dist/diff.js] /var/lib/gitlab/.node_modules/diff/dist/diff.js 184 kB {main} [built]
[../../../../../lib/nodejs/babel-loader/lib/index.js!./ide/lib/diff/diff_worker.js] /usr/lib/nodejs/babel-loader/lib!./ide/lib/diff/diff_worker.js + 1 modules 1.1 kB {main} [built]
A dependency job for gitlab.service failed. See 'journalctl -xe' for details.
invoke-rc.d: initscript gitlab, action "start" failed.
● gitlab.service - GitLab Services
Loaded: loaded (/lib/systemd/system/gitlab.service; enabled; vendor preset: enabled)
Active: inactive (dead) since Thu 2018-03-22 10:43:41 CET; 5 days ago
Main PID: 4989 (code=exited, status=0/SUCCESS)
Mar 27 19:12:51 kanade.darkbolt.net systemd[1]: Dependency failed for GitLab Services.
Mar 27 19:12:51 kanade.darkbolt.net systemd[1]: gitlab.service: Job gitlab.service/start failed with result 'dependency'.
Mar 27 19:27:39 kanade.darkbolt.net systemd[1]: Dependency failed for GitLab Services.
Mar 27 19:27:39 kanade.darkbolt.net systemd[1]: gitlab.service: Job gitlab.service/start failed with result 'dependency'.
Mar 27 20:24:02 kanade.darkbolt.net systemd[1]: Dependency failed for GitLab Services.
Mar 27 20:24:02 kanade.darkbolt.net systemd[1]: gitlab.service: Job gitlab.service/start failed with result 'dependency'.
Mar 28 02:15:30 kanade.darkbolt.net systemd[1]: Dependency failed for GitLab Services.
Mar 28 02:15:30 kanade.darkbolt.net systemd[1]: gitlab.service: Job gitlab.service/start failed with result 'dependency'.
Mar 28 02:27:00 kanade.darkbolt.net systemd[1]: Dependency failed for GitLab Services.
Mar 28 02:27:00 kanade.darkbolt.net systemd[1]: gitlab.service: Job gitlab.service/start failed with result 'dependency'.
dpkg: error processing package gitlab (--configure):
installed gitlab package post-installation script subprocess returned error exit status 1
Processing triggers for systemd (238-3) ...
Errors were encountered while processing:
gitlab
E: Sub-process /usr/bin/dpkg returned an error code (1)
kanade:~# journalctl -xe
-- Subject: Unit gitlab-mailroom.service has finished start-up
-- Defined-By: systemd
-- Support: https://www.debian.org/support
--
-- Unit gitlab-mailroom.service has finished starting up.
--
-- The start-up result is RESULT.
Mar 28 02:26:28 kanade.darkbolt.net gitlab-workhorse[29141]: time="2018-03-28T02:26:28+02:00" level=info msg=Starting version="gitlab-workhorse (unknown version)"
Mar 28 02:26:29 kanade.darkbolt.net gitlab-sidekiq[29135]: bundler: failed to load command: sidekiq (/usr/local/bin/sidekiq)
Mar 28 02:26:29 kanade.darkbolt.net gitlab-sidekiq[29135]: LoadError: cannot load such file -- /usr/share/rubygems-integration/all/specifications/bin/sidekiq
Mar 28 02:26:29 kanade.darkbolt.net gitlab-sidekiq[29135]: /usr/local/bin/sidekiq:23:in `load'
Mar 28 02:26:29 kanade.darkbolt.net gitlab-sidekiq[29135]: /usr/local/bin/sidekiq:23:in `<top (required)>'
Mar 28 02:26:29 kanade.darkbolt.net systemd[1]: gitlab-sidekiq.service: Main process exited, code=exited, status=1/FAILURE
Mar 28 02:27:00 kanade.darkbolt.net systemd[1]: gitlab-sidekiq.service: Failed with result 'exit-code'.
Mar 28 02:27:00 kanade.darkbolt.net systemd[1]: Failed to start GitLab Sidekiq Worker.
-- Subject: Unit gitlab-sidekiq.service has failed
-- Defined-By: systemd
-- Support: https://www.debian.org/support
--
-- Unit gitlab-sidekiq.service has failed.
--
-- The result is RESULT.
Mar 28 02:27:00 kanade.darkbolt.net systemd[1]: Dependency failed for GitLab Services.
-- Subject: Unit gitlab.service has failed
-- Defined-By: systemd
-- Support: https://www.debian.org/support
--
-- Unit gitlab.service has failed.
--
-- The result is RESULT.
Mar 28 02:27:00 kanade.darkbolt.net systemd[1]: gitlab.service: Job gitlab.service/start failed with result 'dependency'.
Mar 28 02:27:00 kanade.darkbolt.net systemd[1]: Reloading.
Mar 28 02:27:01 kanade.darkbolt.net systemd[1]: /lib/systemd/system/gitlab-sidekiq.service:19: Ignoring unknown escape sequences: "for i in 4 4 4 4 4 4 4 4; do sleep $i; (ps -h -o command -p $MAINPID | grep -q -P "sidekiq \d\.\d\.\d") && exit 0; done"
Folder /var/lib/gems/2.5.0/ are clean. All (locally installed) gems have been uninstalled by "gem uninstall", and folder deleted by apt-get remove ruby.
There's some gems on /var/lib/gems/2.3.0/ folder. Maybe from a old installation of ruby. "gem uninstall" doesn't find any of these gems.
I've tried at least three times, complete uninstall and reinstall. Not working.
After uninstall ruby, I've search on dpkg -l for uninstalled packages with remain configuration for purge them. Not working too.
I don't have any problem on deleting something more, I can understand there's a local issue. I need some tests or workaround for detecting the problem and resolve it.
Thanks,
-- System Information:
Debian Release: buster/sid
APT prefers unstable
APT policy: (500, 'unstable'), (500, 'testing')
Architecture: amd64 (x86_64)
Kernel: Linux 4.9.23-xxxx-grs-ipv6-64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_GB:en (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
Versions of packages gitlab depends on:
ii adduser 3.117
ii asciidoctor 1.5.5-1
ii bc 1.07.1-2
ii bundler 1.16.1-1
ii dbconfig-pgsql 2.0.9
ii debconf [debconf-2.0] 1.5.66
ii exim4-daemon-light [mail-transport-agent] 4.90.1-4
ii git 1:2.16.2-1
ii gitlab-shell 6.0.4-1
ii gitlab-workhorse 3.8.0+debian-1
ii libjs-chartjs 1.0.2-1
ii libjs-clipboard 1.4.2-1
ii libjs-graphael 0.5+dfsg-1
ii libjs-jquery-atwho 1.5.4+dfsg.1-2
ii libjs-jquery-caret.js 0.3.1+dfsg.1-2
ii libjs-jquery-nicescroll 3.6.6-1
ii libjs-pdf 1.5.188+dfsg-1
ii libjs-xterm 2.7.0+ds1-1
ii lsb-base 9.20170808
ii nginx 1.13.10-1
ii nginx-full [nginx] 1.13.10-1
ii node-babel-core 6.26.0+dfsg-3
ii node-babel-eslint 7.2.3-2
ii node-babel-loader 7.1.2-4
ii node-babel-plugin-transform-define 1.3.0-2
ii node-babel-preset-latest 6.26.0+dfsg-3
ii node-babel-preset-stage-2 6.26.0+dfsg-3
ii node-bootstrap-sass 3.3.7-1
ii node-core-js 2.4.1-2
ii node-d3-array 1.2.1-3
ii node-d3-axis 1.0.8-3
ii node-d3-brush 1.0.4-3
ii node-d3-scale 1.0.6-3
ii node-d3-selection 1.1.0-3
ii node-d3-shape 1.2.0-2
ii node-d3-time 1.0.7-2
ii node-d3-time-format 2.0.5-2
ii node-debug 3.1.0-1
ii node-exports-loader 0.6.4-1
ii node-file-loader 0.11.2-1
ii node-glob 7.1.2-5
ii node-imports-loader 0.7.1-1
ii node-jed 1.1.1-1
ii node-jquery 2.2.4+dfsg-2
ii node-js-cookie 2.2.0-1
ii node-jszip 3.1.4+dfsg-1
ii node-jszip-utils 0.0.2+dfsg-1
ii node-katex 0.8.3+dfsg-1
ii node-lie 3.1.1+dfsg-1
ii node-marked 0.3.9+dfsg-1
ii node-mousetrap 1.6.1+ds-1
ii node-raw-loader 0.5.1-1
ii node-stats-webpack-plugin 0.6.1-1
ii node-underscore 1.8.3~dfsg-1
ii node-url-loader 0.5.9-1
ii nodejs 8.9.3~dfsg-12
ii npm 1.4.21+ds-2
ii openssh-client 1:7.6p1-4
ii postgresql-client 10+190
ii postgresql-client-10 [postgresql-client] 10.3-2
ii postgresql-contrib 10+190
ii rake 12.3.1-1
ii redis-server 5:4.0.7-1
ii ruby 1:2.5.1
ii ruby-ace-rails-ap 4.1.1-1
ii ruby-acts-as-taggable-on 5.0.0-2
ii ruby-addressable 2.5.2-1
ii ruby-akismet 2.0.0-1
ii ruby-allocations 1.0.3-1+b3
ii ruby-asana 0.6.0-1
ii ruby-asciidoctor-plantuml 0.0.7-1
ii ruby-asset-sync 2.2.0-2
ii ruby-attr-encrypted 3.0.1-2
ii ruby-babosa 1.0.2-2
ii ruby-base32 0.3.2-3
ii ruby-batch-loader 1.2.1-1
ii ruby-bcrypt-pbkdf 1.0.0-1+b1
ii ruby-bootstrap-form 2.7.0-1
ii ruby-bootstrap-sass 3.3.5.1-5
ii ruby-browser 2.2.0-2
ii ruby-carrierwave 1.2.2-1
ii ruby-charlock-holmes 0.7.5-1
ii ruby-chronic 0.10.2-3
ii ruby-chronic-duration 0.10.6-1
ii ruby-connection-pool 2.2.0-1
ii ruby-creole 0.5.0-2
ii ruby-d3-rails 3.5.6+dfsg-1
ii ruby-default-value-for 3.0.1-1
ii ruby-devise 4.4.3-1
ii ruby-devise-two-factor 3.0.0-2
ii ruby-diffy 3.1.0-1
ii ruby-doorkeeper 4.3.1-1
ii ruby-doorkeeper-openid-connect 1.3.0-1
ii ruby-dropzonejs-rails 0.7.1-1
ii ruby-email-reply-trimmer 0.1.6-1
ii ruby-excon 0.60.0-1
ii ruby-faraday 0.13.1-2
ii ruby-fast-blank 1.0.0-1
ii ruby-flipper 0.13.0-3
pn ruby-flipper-active-record <none>
pn ruby-flipper-active-support-cache-store <none>
ii ruby-fog-aliyun 0.2.0-1
ii ruby-fog-aws 2.0.0-3
ii ruby-fog-core 1.45.0-1
ii ruby-fog-google 0.5.3-1
ii ruby-fog-local 0.3.0-1
ii ruby-fog-openstack 0.1.6-4
ii ruby-fog-rackspace 0.1.1-4
ii ruby-fogbugz 0.2.1-3
ii ruby-font-awesome-rails 4.7.0.2-1
ii ruby-gemnasium-gitlab-service 0.2.6-2
ii ruby-gemojione 3.3.0-1
ii ruby-gettext-i18n-rails 1.8.0-1
ii ruby-gettext-i18n-rails-js 1.3.0+dfsg-1
ii ruby-gitaly 0.89.0+dfsg-1
ii ruby-github-linguist 4.7.2-3
ii ruby-github-markup 1.6.3-1
ii ruby-gitlab-flowdock-git-hook 1.0.1-4
ii ruby-gollum-lib 4.2.7-1
ii ruby-gollum-rugged-adapter 0.4.4-2
ii ruby-gon 6.1.0-1
ii ruby-google-api-client 0.19.8-1
ii ruby-google-protobuf 3.2.0-2+b1
ii ruby-gpgme 2.0.16-1
ii ruby-grape 1.0.2-1
ii ruby-grape-entity 0.6.0-1
ii ruby-grape-logging 1.7.0-1
ii ruby-grape-route-helpers 2.1.0-2
ii ruby-hamlit 2.8.7-2
ii ruby-hashie-forbidden-attributes 0.1.1-1
ii ruby-health-check 2.6.0-1
ii ruby-hipchat 1.5.2-3
ii ruby-html-pipeline 1.11.0-1
ii ruby-html2text 0.2.0-1
ii ruby-httparty 0.15.6-1
ii ruby-influxdb 0.2.3-2
ii ruby-jira 1.4.3-1
ii ruby-jquery-atwho-rails 1.3.2-2
ii ruby-jquery-rails 4.3.1-1
ii ruby-jwt 1.5.6-1
ii ruby-kaminari 1.0.1-3
ii ruby-kubeclient 3.0.0-1
ii ruby-licensee 8.9.2-1
ii ruby-lograge 0.5.0-1
ii ruby-loofah 2.2.2-1
ii ruby-mail-room 0.9.1-2
ii ruby-method-source 0.9.0-1
ii ruby-mousetrap-rails 1.4.6-6
ii ruby-net-ldap 0.16.1-1
ii ruby-net-ssh 1:4.2.0-2
ii ruby-nokogiri 1.8.2-1
ii ruby-oauth2 1.4.0-2
ii ruby-octokit 4.7.0-3
ii ruby-oj 3.4.0-1
ii ruby-omniauth 1.6.1-2
ii ruby-omniauth-auth0 2.0.0-1
ii ruby-omniauth-authentiq 0.3.1-1
ii ruby-omniauth-azure-oauth2 0.0.9-2
ii ruby-omniauth-cas3 1.1.4-1
ii ruby-omniauth-crowd 2.2.3-3
ii ruby-omniauth-facebook 4.0.0-2
ii ruby-omniauth-github 1.1.2-2
ii ruby-omniauth-gitlab 1.0.2-1
ii ruby-omniauth-google-oauth2 0.5.2-2
ii ruby-omniauth-kerberos 0.3.0-3
ii ruby-omniauth-ldap 2.0.4-1
ii ruby-omniauth-oauth2-generic 0.2.2-1
ii ruby-omniauth-saml 1.7.0-1
ii ruby-omniauth-shibboleth 1.2.1-1
ii ruby-omniauth-twitter 1.4.0-1
ii ruby-org 0.9.12-2
ii ruby-paranoia 2.3.1-1
ii ruby-parser 3.8.2-1
ii ruby-peek 1.0.1-1
ii ruby-peek-gc 0.0.2-1
ii ruby-peek-host 1.0.0-1
ii ruby-peek-performance-bar 1.3.0-1
ii ruby-peek-pg 1.3.0-1
ii ruby-peek-rblineprof 0.2.0-1
ii ruby-peek-redis 1.2.0-1
ii ruby-peek-sidekiq 1.0.3-1
ii ruby-pg 0.19.0-2
ii ruby-premailer-rails 1.9.7-1
ii ruby-prof 0.17.0+dfsg-3
ii ruby-prometheus-client-mmap 0.9.1-1
ii ruby-rack-attack 4.4.1-1
ii ruby-rack-cors 1.0.1-2
ii ruby-rack-oauth2 1.4.0-1
ii ruby-rack-proxy 0.6.1-2
ii ruby-rack-test 0.7.0-1
ii ruby-rails 2:4.2.10-1
ii ruby-rails-deprecated-sanitizer 1.0.3-2
ii ruby-rails-dom-testing 1.0.6-2
ii ruby-rails-i18n 4.0.9-1
ii ruby-rainbow 2.2.2-1
ii ruby-raindrops 0.19.0-1+b1
ii ruby-rbnacl [ruby-rbnacl-libsodium] 5.0.0-3
ii ruby-re2 1.1.1-2+b1
ii ruby-recaptcha 3.2.0-3
ii ruby-redcarpet 3.4.0-4
ii ruby-redcloth 4.3.2-3
ii ruby-redis 3.3.3-1
ii ruby-redis-namespace 1.5.2-3
ii ruby-redis-rails 5.0.2-3
ii ruby-request-store 1.3.0-1
ii ruby-responders 2.4.0-1
ii ruby-rouge 2.2.1-1
ii ruby-rqrcode-rails3 0.1.7-1
ii ruby-rufus-scheduler 3.4.2-1
ii ruby-rugged 0.26.0-2+b1
ii ruby-sanitize 2.1.0-2
ii ruby-sass-rails 5.0.6-1
ii ruby-seed-fu 2.3.7-1
ii ruby-select2-rails 3.5.9.3-2
ii ruby-sentry-raven 2.6.3-1
ii ruby-settingslogic 2.0.9-3
ii ruby-sidekiq 5.0.4+dfsg-2
ii ruby-sidekiq-cron 0.6.3-4
ii ruby-sidekiq-limit-fetch 3.4.0-2
ii ruby-slack-notifier 1.5.1-1
ii ruby-sprockets 3.7.0-1
ii ruby-state-machines-activerecord 0.4.0-1
ii ruby-sys-filesystem 1.1.7-2
ii ruby-task-list 2.0.0-2
ii ruby-toml-rb 1.0.0-1
ii ruby-truncato 0.7.9-1
ii ruby-u2f 0.2.1-2
ii ruby-uglifier 2.7.2+dfsg-2
ii ruby-unf 0.1.4-2
ii ruby-unicorn-worker-killer 0.4.4-1
ii ruby-validates-hostname 1.0.7-1
ii ruby-version-sorter 2.1.0+dfsg-1+b1
ii ruby-virtus 1.0.5-3
ii ruby-vmstat 2.3.0-2
ii ruby-webpack-rails 0.9.11-1
ii ruby-wikicloth 0.8.1+dfsg-4
ii ucf 3.0038
ii unicorn 5.4.0-1
Versions of packages gitlab recommends:
ii certbot 0.21.1-1
gitlab suggests no packages.
-- debconf information:
* gitlab/dbconfig-install: true
gitlab/upgrade-backup: true
gitlab/pgsql/manualconf:
gitlab/db/app-user: gitlab at localhost
* gitlab/remote/host: localhost
gitlab/purge: false
gitlab/missing-db-package-error: abort
gitlab/pgsql/changeconf: false
gitlab/passwords-do-not-match:
gitlab/internal/reconfiguring: false
* gitlab/user: gitlab
gitlab/pgsql/no-empty-passwords:
gitlab/db/dbname: gitlab_production
gitlab/dbconfig-upgrade: true
gitlab/upgrade-error: abort
* gitlab/letsencrypt_email: domains at darkbolt.net
gitlab/internal/skip-preseed: false
gitlab/purge_data: true
* gitlab/letsencrypt: true
gitlab/pgsql/authmethod-admin: ident
* gitlab/ssl: true
gitlab/dbconfig-reinstall: false
* gitlab/database-type: pgsql
gitlab/pgsql/authmethod-user: password
* gitlab/fqdn: git.darkbolt.net
gitlab/install-error: abort
gitlab/dbconfig-remove: true
gitlab/pgsql/method: TCP/IP
gitlab/pgsql/admin-user: postgres
gitlab/remove-error: abort
gitlab/remote/newhost: localhost
gitlab/remote/port:
More information about the Pkg-ruby-extras-maintainers
mailing list