[Pkg-puppet-devel] Bug#946596: puppetdb: An illegal reflective access operation has occurred - puppetdb killed

[Matt Zagrabelny]

Package: puppetdb
Version: 6.2.0-3
Severity: important

Greetings,

Thank you for your support of puppetdb.

I have successfully installed and configured puppetdb and it seemed to have
been running smoothly for a number of weeks.

This morning it started to fail with the following error:

Dec 11 09:00:18 puppet-5-5 java[922]: WARNING: An illegal reflective access operation has occurred
Dec 11 09:00:18 puppet-5-5 java[922]: WARNING: Illegal reflective access by clojure.lang.InjectedInvoker/0x00000008401e8040 (file:/usr/share/java/clojure.jar) to method sun.nio.ch.ChannelInputStream.close()
Dec 11 09:00:18 puppet-5-5 java[922]: WARNING: Please consider reporting this to the maintainers of clojure.lang.InjectedInvoker/0x00000008401e8040
Dec 11 09:00:18 puppet-5-5 java[922]: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
Dec 11 09:00:18 puppet-5-5 java[922]: WARNING: All illegal access operations will be denied in a future release
Dec 11 09:00:19 puppet-5-5 java[922]: #
Dec 11 09:00:19 puppet-5-5 java[922]: # java.lang.OutOfMemoryError: Java heap space
Dec 11 09:00:19 puppet-5-5 java[922]: # -XX:OnOutOfMemoryError="kill -9 %p"
Dec 11 09:00:19 puppet-5-5 java[922]: #   Executing /bin/sh -c "kill -9 922"...
Dec 11 09:00:19 puppet-5-5 systemd[1]: puppetdb.service: Main process exited, code=killed, status=9/KILL
Dec 11 09:00:19 puppet-5-5 systemd[1]: puppetdb.service: Failed with result 'signal'.

I've tweaked the systemd unit file via:

sudo cp /lib/systemd/system/puppetdb.service /etc/systemd/system/puppetdb.service

and removed the line:

  -XX:OnOutOfMemoryError="kill -9 %%p" \

Then:

sudo systemctl daemon-reload
sudo systemctl restart puppetdb

It seems to be working okay again, but I thought I should submit a report to document the issue.

Please let me know if there is something I can do to triage this more.

Thank you!