containers icon indicating copy to clipboard operation
containers copied to clipboard
verified publisher icon bitnami

Solr exits on second start of container (with docker-compose)

Open rosenbjerg opened this issue 4 years ago • 6 comments

When starting the bitnami/solr container for the second time with docker-compose, it fails with: Port 8983 is already being used by another process (pid: 88)

Steps to reproduce the issue:

  1. Start bitnami/solr container with docker-compose up docker-compose.yml file used:
version: '3.5'

services:
  bitnami-solr:
    image: bitnami/solr:8
  1. Stop container (eg. with Ctrl+C)
  2. Restart container with docker-compose up

Describe the results you received:

On the very first startup, the solr instance starts up correctly and the container keeps running. On second startup, the solr process is unable to use the same port again, probably because another instance of solr is running in the background and using that port. The solr instance then exits with exit-code 1, and the container does the same. To be able to start a working solr container, I have to delete the existing container (i.e. with docker-compose down) and then start again. image

Describe the results you expected:

I expect the container-image to be set up to allow for restarting an existing stopped container. This problem seems to be caused by the ENTRYPOINT or CMD isn't properly handling that solr is already running in the background. It may also be a mistake that solr is installed as a background service that automatically starts, since the ENTRYPOINT/CMD normally is supposed to be responsible for starting the "main" process of the container.

Additional information you deem important (e.g. issue happens only occasionally):

I can reproduce the error consistently with this extremely minimal docker-compose file.

Interestingly, sometimes the second startup will succeed and it will then fail on the third startup instead. I think this has to do with how quickly the container is stopped after startup.

Version

  • Output of docker version:
Client:
 Cloud integration: v1.0.20
 Version:           20.10.10
 API version:       1.41
 Go version:        go1.16.9
 Git commit:        b485636
 Built:             Mon Oct 25 07:47:53 2021
 OS/Arch:           windows/amd64
 Context:           default
 Experimental:      true

Server: Docker Engine - Community
 Engine:
  Version:          20.10.10
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.16.9
  Git commit:       e2f740d
  Built:            Mon Oct 25 07:41:30 2021
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.4.11
  GitCommit:        5b46e404f6b9f661a205e28d59c982d3634148f8
 runc:
  Version:          1.0.2
  GitCommit:        v1.0.2-0-g52b36a2
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0
  • Output of docker info:
Client:
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Build with BuildKit (Docker Inc., v0.6.3)
  compose: Docker Compose (Docker Inc., v2.1.1)
  scan: Docker Scan (Docker Inc., 0.9.0)

Server:
 Containers: 8
  Running: 5
  Paused: 0
  Stopped: 3
 Images: 17
 Server Version: 20.10.10
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 1
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: runc io.containerd.runc.v2 io.containerd.runtime.v1.linux
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 5b46e404f6b9f661a205e28d59c982d3634148f8
 runc version: v1.0.2-0-g52b36a2
 init version: de40ad0
 Security Options:
  seccomp
   Profile: default
 Kernel Version: 5.10.60.1-microsoft-standard-WSL2
 Operating System: Docker Desktop
 OSType: linux
 Architecture: x86_64
 CPUs: 16
 Total Memory: 24.99GiB
 Name: docker-desktop
 ID: GIQ4:NRXM:3EIE:WBFD:CUTU:CMIW:T7GJ:VCKM:O3I7:IBBK:SJXR:4BM4
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

WARNING: No blkio throttle.read_bps_device support
WARNING: No blkio throttle.write_bps_device support
WARNING: No blkio throttle.read_iops_device support
WARNING: No blkio throttle.write_iops_device support
  • Output of docker-compose version (if applicable):
Docker Compose version v2.1.1

Additional environment details (AWS, VirtualBox, Docker for MAC, physical, etc.):

rosenbjerg avatar Nov 28 '21 16:11 rosenbjerg

Hi,

I was unable to reproduce the issue

$ docker-compose up
Creating network "solr_default" with the default driver
Pulling bitnami-solr (bitnami/solr:8)...
8: Pulling from bitnami/solr
ad3e435fd20e: Already exists
be91dfe4f6b0: Pull complete
2af603a17de6: Pull complete
0d1bfe5f7923: Pull complete
e640e644d0c8: Pull complete
fc85207a7d8e: Pull complete
3b18a4e5368d: Pull complete
7d2231927b16: Pull complete
695c958aef08: Pull complete
Digest: sha256:302dcf57033360a5dde13e69b6195da2796381842f40a8e1a782a99108571e24
Status: Downloaded newer image for bitnami/solr:8
Creating solr_bitnami-solr_1 ... done
Attaching to solr_bitnami-solr_1
bitnami-solr_1  | solr 10:35:44.57
bitnami-solr_1  | solr 10:35:44.58 Welcome to the Bitnami solr container
bitnami-solr_1  | solr 10:35:44.58 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-solr
bitnami-solr_1  | solr 10:35:44.58 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-solr/issues
bitnami-solr_1  | solr 10:35:44.58
bitnami-solr_1  | solr 10:35:44.59 INFO  ==> ** Starting solr setup **
bitnami-solr_1  | solr 10:35:44.60 INFO  ==> Validating settings in SOLR_* env vars...
bitnami-solr_1  | solr 10:35:44.60 INFO  ==> Initializing Solr ...
bitnami-solr_1  | solr 10:35:44.65 INFO  ==> Configuring file permissions for Solr
bitnami-solr_1  | solr 10:35:44.66 INFO  ==> Deploying Solr from scratch
bitnami-solr_1  | solr 10:35:44.66 INFO  ==> Starting solr in background


bitnami-solr_1  | solr 10:35:49.66 INFO  ==> Wait for Solr API
bitnami-solr_1  | solr 10:35:49.98 INFO  ==> Stopping solr
bitnami-solr_1  | solr 10:35:50.99 INFO  ==> Persisting Solr installation
bitnami-solr_1  |
bitnami-solr_1  | solr 10:35:51.06 INFO  ==> ** solr setup finished! **
bitnami-solr_1  | solr 10:35:51.09 INFO  ==> ** Starting solr **
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | 2021-11-29 10:35:52.563 INFO  (main) [   ] o.e.j.u.log Logging initialized @1308ms to org.eclipse.jetty.util.log.Slf4jLog
bitnami-solr_1  | 2021-11-29 10:35:52.845 INFO  (main) [   ] o.e.j.s.Server jetty-9.4.44.v20210927; built: 2021-09-27T23:02:44.612Z; git: 8da83308eeca865e495e53ef315a249d63ba9332; jvm 1.8.0_312-b07
bitnami-solr_1  | 2021-11-29 10:35:52.864 INFO  (main) [   ] o.e.j.d.p.ScanningAppProvider Deployment monitor [file:///opt/bitnami/solr/server/contexts/] at interval 0
bitnami-solr_1  | 2021-11-29 10:35:53.160 INFO  (main) [   ] o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet
bitnami-solr_1  | 2021-11-29 10:35:53.206 INFO  (main) [   ] o.e.j.s.session DefaultSessionIdManager workerName=node0
bitnami-solr_1  | 2021-11-29 10:35:53.206 INFO  (main) [   ] o.e.j.s.session No SessionScavenger set, using defaults
bitnami-solr_1  | 2021-11-29 10:35:53.210 INFO  (main) [   ] o.e.j.s.session node0 Scavenging every 600000ms
bitnami-solr_1  | 2021-11-29 10:35:53.288 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
bitnami-solr_1  | 2021-11-29 10:35:53.292 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.11.0
bitnami-solr_1  | 2021-11-29 10:35:53.292 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port 8983
bitnami-solr_1  | 2021-11-29 10:35:53.292 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /opt/bitnami/solr
bitnami-solr_1  | 2021-11-29 10:35:53.293 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-11-29T10:35:53.293Z
bitnami-solr_1  | 2021-11-29 10:35:53.330 INFO  (main) [   ] o.a.s.c.SolrPaths Using system property solr.solr.home: /opt/bitnami/solr/server/solr
bitnami-solr_1  | 2021-11-29 10:35:53.331 INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading container configuration from /opt/bitnami/solr/server/solr/solr.xml
bitnami-solr_1  | 2021-11-29 10:35:53.456 INFO  (main) [   ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6, but no JMX reporters were configured - adding default JMX reporter.
bitnami-solr_1  | 2021-11-29 10:35:54.047 INFO  (main) [   ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
bitnami-solr_1  | 2021-11-29 10:35:54.291 WARN  (main) [   ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4ba534b0[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 10:35:54.291 WARN  (main) [   ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4ba534b0[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 10:35:54.464 WARN  (main) [   ] o.e.j.u.s.S.config Trusting all certificates configured for Client@53499d85[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 10:35:54.464 WARN  (main) [   ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@53499d85[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 10:35:54.521 WARN  (main) [   ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
bitnami-solr_1  | 2021-11-29 10:35:54.693 INFO  (main) [   ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient core cache for max 2147483647 cores with initial capacity of 1024
bitnami-solr_1  | 2021-11-29 10:35:54.706 INFO  (main) [   ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
bitnami-solr_1  | 2021-11-29 10:35:54.790 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 10:35:54.791 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 10:35:54.792 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 10:35:54.833 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /opt/bitnami/solr/server/solr
bitnami-solr_1  | 2021-11-29 10:35:54.906 INFO  (main) [   ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@2d901eb0{/solr,file:///opt/bitnami/solr/server/solr-webapp/webapp/,AVAILABLE}{/opt/bitnami/solr/server/solr-webapp/webapp}
bitnami-solr_1  | 2021-11-29 10:35:54.930 INFO  (main) [   ] o.e.j.s.AbstractConnector Started ServerConnector@7133da86{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8983}
bitnami-solr_1  | 2021-11-29 10:35:54.930 INFO  (main) [   ] o.e.j.s.Server Started @3678ms


^CGracefully stopping... (press Ctrl+C again to force)
Killing solr_bitnami-solr_1  ... done
ERROR: 2
 /tmp/solr                                                                        11:36:08  jsalmeron

$ docker-compose up
Starting solr_bitnami-solr_1 ... done
Attaching to solr_bitnami-solr_1
bitnami-solr_1  | solr 10:36:13.14
bitnami-solr_1  | solr 10:36:13.14 Welcome to the Bitnami solr container
bitnami-solr_1  | solr 10:36:13.14 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-solr
bitnami-solr_1  | solr 10:36:13.14 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-solr/issues
bitnami-solr_1  | solr 10:36:13.14
bitnami-solr_1  | solr 10:36:13.14 INFO  ==> ** Starting solr setup **
bitnami-solr_1  | solr 10:36:13.16 INFO  ==> Validating settings in SOLR_* env vars...
bitnami-solr_1  | solr 10:36:13.16 INFO  ==> Initializing Solr ...
bitnami-solr_1  | solr 10:36:13.17 INFO  ==> Restoring persisted Solr installation
bitnami-solr_1  |
bitnami-solr_1  | solr 10:36:13.19 INFO  ==> ** solr setup finished! **
bitnami-solr_1  | solr 10:36:13.21 INFO  ==> ** Starting solr **
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | 2021-11-29 10:36:14.688 INFO  (main) [   ] o.e.j.u.log Logging initialized @1325ms to org.eclipse.jetty.util.log.Slf4jLog
bitnami-solr_1  | 2021-11-29 10:36:14.962 INFO  (main) [   ] o.e.j.s.Server jetty-9.4.44.v20210927; built: 2021-09-27T23:02:44.612Z; git: 8da83308eeca865e495e53ef315a249d63ba9332; jvm 1.8.0_312-b07
bitnami-solr_1  | 2021-11-29 10:36:14.980 INFO  (main) [   ] o.e.j.d.p.ScanningAppProvider Deployment monitor [file:///opt/bitnami/solr/server/contexts/] at interval 0
bitnami-solr_1  | 2021-11-29 10:36:15.247 INFO  (main) [   ] o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet
bitnami-solr_1  | 2021-11-29 10:36:15.263 INFO  (main) [   ] o.e.j.s.session DefaultSessionIdManager workerName=node0
bitnami-solr_1  | 2021-11-29 10:36:15.263 INFO  (main) [   ] o.e.j.s.session No SessionScavenger set, using defaults
bitnami-solr_1  | 2021-11-29 10:36:15.266 INFO  (main) [   ] o.e.j.s.session node0 Scavenging every 660000ms
bitnami-solr_1  | 2021-11-29 10:36:15.369 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
bitnami-solr_1  | 2021-11-29 10:36:15.374 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.11.0
bitnami-solr_1  | 2021-11-29 10:36:15.374 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port 8983
bitnami-solr_1  | 2021-11-29 10:36:15.375 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /opt/bitnami/solr
bitnami-solr_1  | 2021-11-29 10:36:15.375 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-11-29T10:36:15.375Z
bitnami-solr_1  | 2021-11-29 10:36:15.412 INFO  (main) [   ] o.a.s.c.SolrPaths Using system property solr.solr.home: /opt/bitnami/solr/server/solr
bitnami-solr_1  | 2021-11-29 10:36:15.413 INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading container configuration from /opt/bitnami/solr/server/solr/solr.xml
bitnami-solr_1  | 2021-11-29 10:36:15.543 INFO  (main) [   ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6, but no JMX reporters were configured - adding default JMX reporter.
bitnami-solr_1  | 2021-11-29 10:36:16.056 INFO  (main) [   ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
bitnami-solr_1  | 2021-11-29 10:36:16.304 WARN  (main) [   ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4ba534b0[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 10:36:16.304 WARN  (main) [   ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4ba534b0[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 10:36:16.483 WARN  (main) [   ] o.e.j.u.s.S.config Trusting all certificates configured for Client@53499d85[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 10:36:16.483 WARN  (main) [   ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@53499d85[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 10:36:16.539 WARN  (main) [   ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
bitnami-solr_1  | 2021-11-29 10:36:16.735 INFO  (main) [   ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient core cache for max 2147483647 cores with initial capacity of 1024
bitnami-solr_1  | 2021-11-29 10:36:16.750 INFO  (main) [   ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
bitnami-solr_1  | 2021-11-29 10:36:16.835 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 10:36:16.836 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 10:36:16.837 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 10:36:16.881 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /opt/bitnami/solr/server/solr
bitnami-solr_1  | 2021-11-29 10:36:16.956 INFO  (main) [   ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@2d901eb0{/solr,file:///opt/bitnami/solr/server/solr-webapp/webapp/,AVAILABLE}{/opt/bitnami/solr/server/solr-webapp/webapp}
bitnami-solr_1  | 2021-11-29 10:36:16.981 INFO  (main) [   ] o.e.j.s.AbstractConnector Started ServerConnector@7133da86{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8983}
bitnami-solr_1  | 2021-11-29 10:36:16.981 INFO  (main) [   ] o.e.j.s.Server Started @3621ms

As you can see, doing down and up did not cause any issue. Do you have any other containers running with solr?

javsalgar avatar Nov 29 '21 10:11 javsalgar

@javsalgar Thank you for the response. No I don't have other Solr instances nor containers running, and I don't expose the ports to host, so no port conflict should be possible between containers. As I mentioned, I can replicate consistently though it isn't always on first stop-restart is fails, sometimes it is on the second. I think it depends on how quickly it is stopped again. If stopped too quickly, it doesn't get to the part of the background initialization that (presumeably) installs the background service.

I have just replicated the issue on different machine, just from the minimal docker-compose.yml example given in the issue. The first time, I just let the logs calm for 5 seconds and then stopped. This time it didn't "install the background service". The second time, I let the logs be calm for 30-45 seconds before stopping, and then on the up after that, it fails

Here are the full console logs:

<path>\solr-debug>docker-compose up
Creating network "solr-debug_default" with the default driver
Creating solr-debug_bitnami-solr_1 ... done                                                                                                                                                                                                                                 Attaching to solr-debug_bitnami-solr_1
bitnami-solr_1  | solr 11:58:59.23
bitnami-solr_1  | solr 11:58:59.23 Welcome to the Bitnami solr container
bitnami-solr_1  | solr 11:58:59.23 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-solr
bitnami-solr_1  | solr 11:58:59.23 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-solr/issues
bitnami-solr_1  | solr 11:58:59.23
bitnami-solr_1  | solr 11:58:59.23 INFO  ==> ** Starting solr setup **
bitnami-solr_1  | solr 11:58:59.24 INFO  ==> Validating settings in SOLR_* env vars...
bitnami-solr_1  | solr 11:58:59.25 INFO  ==> Initializing Solr ...
bitnami-solr_1  | solr 11:58:59.25 INFO  ==> Configuring file permissions for Solr
bitnami-solr_1  | solr 11:58:59.26 INFO  ==> Deploying Solr from scratch
bitnami-solr_1  | solr 11:58:59.26 INFO  ==> Starting solr in background
bitnami-solr_1  | solr 11:59:01.95 INFO  ==> Wait for Solr API
bitnami-solr_1  | solr 11:59:02.12 INFO  ==> Stopping solr
bitnami-solr_1  | solr 11:59:03.13 INFO  ==> Persisting Solr installation
bitnami-solr_1  | solr 11:59:03.19 INFO  ==> ** solr setup finished! **
bitnami-solr_1  |
bitnami-solr_1  | solr 11:59:03.20 INFO  ==> ** Starting solr **
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | 2021-11-29 11:59:03.948 INFO  (main) [   ] o.e.j.u.log Logging initialized @662ms to org.eclipse.jetty.util.log.Slf4jLog
bitnami-solr_1  | 2021-11-29 11:59:04.118 INFO  (main) [   ] o.e.j.s.Server jetty-9.4.44.v20210927; built: 2021-09-27T23:02:44.612Z; git: 8da83308eeca865e495e53ef315a249d63ba9332; jvm 1.8.0_312-b07
bitnami-solr_1  | 2021-11-29 11:59:04.130 INFO  (main) [   ] o.e.j.d.p.ScanningAppProvider Deployment monitor [file:///opt/bitnami/solr/server/contexts/] at interval 0
bitnami-solr_1  | 2021-11-29 11:59:04.322 INFO  (main) [   ] o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet
bitnami-solr_1  | 2021-11-29 11:59:04.334 INFO  (main) [   ] o.e.j.s.session DefaultSessionIdManager workerName=node0
bitnami-solr_1  | 2021-11-29 11:59:04.334 INFO  (main) [   ] o.e.j.s.session No SessionScavenger set, using defaults
bitnami-solr_1  | 2021-11-29 11:59:04.336 INFO  (main) [   ] o.e.j.s.session node0 Scavenging every 600000ms
bitnami-solr_1  | 2021-11-29 11:59:04.388 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
bitnami-solr_1  | 2021-11-29 11:59:04.411 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.10.1
bitnami-solr_1  | 2021-11-29 11:59:04.412 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port 8983
bitnami-solr_1  | 2021-11-29 11:59:04.412 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /opt/bitnami/solr
bitnami-solr_1  | 2021-11-29 11:59:04.412 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-11-29T11:59:04.412Z
bitnami-solr_1  | 2021-11-29 11:59:04.437 INFO  (main) [   ] o.a.s.c.SolrPaths Using system property solr.solr.home: /opt/bitnami/solr/server/solr
bitnami-solr_1  | 2021-11-29 11:59:04.437 INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading container configuration from /opt/bitnami/solr/server/solr/solr.xml
bitnami-solr_1  | 2021-11-29 11:59:04.500 INFO  (main) [   ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6, but no JMX reporters were configured - adding default JMX reporter.
bitnami-solr_1  | 2021-11-29 11:59:04.855 INFO  (main) [   ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
bitnami-solr_1  | 2021-11-29 11:59:04.979 WARN  (main) [   ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4ba534b0[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 11:59:04.980 WARN  (main) [   ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4ba534b0[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 11:59:05.100 WARN  (main) [   ] o.e.j.u.s.S.config Trusting all certificates configured for Client@53499d85[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 11:59:05.100 WARN  (main) [   ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@53499d85[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 11:59:05.140 WARN  (main) [   ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
bitnami-solr_1  | 2021-11-29 11:59:05.283 INFO  (main) [   ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient core cache for max 2147483647 cores with initial capacity of 1024
bitnami-solr_1  | 2021-11-29 11:59:05.294 INFO  (main) [   ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
bitnami-solr_1  | 2021-11-29 11:59:05.356 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 11:59:05.356 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 11:59:05.357 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 11:59:05.392 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /opt/bitnami/solr/server/solr
bitnami-solr_1  | 2021-11-29 11:59:05.444 INFO  (main) [   ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@2d901eb0{/solr,file:///opt/bitnami/solr/server/solr-webapp/webapp/,AVAILABLE}{/opt/bitnami/solr/server/solr-webapp/webapp}
bitnami-solr_1  | 2021-11-29 11:59:05.458 INFO  (main) [   ] o.e.j.s.AbstractConnector Started ServerConnector@7133da86{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8983}
bitnami-solr_1  | 2021-11-29 11:59:05.458 INFO  (main) [   ] o.e.j.s.Server Started @2174ms
Gracefully stopping... (press Ctrl+C again to force)
Stopping solr-debug_bitnami-solr_1 ... done              
                                                                                                                                                                                                                   
<path>\solr-debug>docker-compose up
Starting solr-debug_bitnami-solr_1 ... done                                                                                                                                                                                                                                 Attaching to solr-debug_bitnami-solr_1
bitnami-solr_1  | solr 11:59:17.22
bitnami-solr_1  | solr 11:59:17.22 Welcome to the Bitnami solr container
bitnami-solr_1  | solr 11:59:17.22 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-solr
bitnami-solr_1  | solr 11:59:17.23 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-solr/issues
bitnami-solr_1  | solr 11:59:17.23
bitnami-solr_1  | solr 11:59:17.23 INFO  ==> ** Starting solr setup **
bitnami-solr_1  | solr 11:59:17.24 INFO  ==> Validating settings in SOLR_* env vars...
bitnami-solr_1  | solr 11:59:17.24 INFO  ==> Initializing Solr ...
bitnami-solr_1  | solr 11:59:17.25 INFO  ==> Restoring persisted Solr installation
bitnami-solr_1  | solr 11:59:17.26 INFO  ==> ** solr setup finished! **
bitnami-solr_1  |
bitnami-solr_1  | solr 11:59:17.27 INFO  ==> ** Starting solr **
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory. (error = 12)
bitnami-solr_1  | 2021-11-29 11:59:18.022 INFO  (main) [   ] o.e.j.u.log Logging initialized @665ms to org.eclipse.jetty.util.log.Slf4jLog
bitnami-solr_1  | 2021-11-29 11:59:18.196 INFO  (main) [   ] o.e.j.s.Server jetty-9.4.44.v20210927; built: 2021-09-27T23:02:44.612Z; git: 8da83308eeca865e495e53ef315a249d63ba9332; jvm 1.8.0_312-b07
bitnami-solr_1  | 2021-11-29 11:59:18.209 INFO  (main) [   ] o.e.j.d.p.ScanningAppProvider Deployment monitor [file:///opt/bitnami/solr/server/contexts/] at interval 0
bitnami-solr_1  | 2021-11-29 11:59:18.401 INFO  (main) [   ] o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet
bitnami-solr_1  | 2021-11-29 11:59:18.411 INFO  (main) [   ] o.e.j.s.session DefaultSessionIdManager workerName=node0
bitnami-solr_1  | 2021-11-29 11:59:18.411 INFO  (main) [   ] o.e.j.s.session No SessionScavenger set, using defaults
bitnami-solr_1  | 2021-11-29 11:59:18.414 INFO  (main) [   ] o.e.j.s.session node0 Scavenging every 660000ms
bitnami-solr_1  | 2021-11-29 11:59:18.488 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
bitnami-solr_1  | 2021-11-29 11:59:18.508 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.10.1
bitnami-solr_1  | 2021-11-29 11:59:18.508 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port 8983
bitnami-solr_1  | 2021-11-29 11:59:18.508 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /opt/bitnami/solr
bitnami-solr_1  | 2021-11-29 11:59:18.508 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-11-29T11:59:18.508Z
bitnami-solr_1  | 2021-11-29 11:59:18.532 INFO  (main) [   ] o.a.s.c.SolrPaths Using system property solr.solr.home: /opt/bitnami/solr/server/solr
bitnami-solr_1  | 2021-11-29 11:59:18.532 INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading container configuration from /opt/bitnami/solr/server/solr/solr.xml
bitnami-solr_1  | 2021-11-29 11:59:18.593 INFO  (main) [   ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6, but no JMX reporters were configured - adding default JMX reporter.
bitnami-solr_1  | 2021-11-29 11:59:19.000 INFO  (main) [   ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
bitnami-solr_1  | 2021-11-29 11:59:19.139 WARN  (main) [   ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4ba534b0[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 11:59:19.139 WARN  (main) [   ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4ba534b0[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 11:59:19.255 WARN  (main) [   ] o.e.j.u.s.S.config Trusting all certificates configured for Client@53499d85[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 11:59:19.255 WARN  (main) [   ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@53499d85[provider=null,keyStore=null,trustStore=null]
bitnami-solr_1  | 2021-11-29 11:59:19.292 WARN  (main) [   ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
bitnami-solr_1  | 2021-11-29 11:59:19.421 INFO  (main) [   ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient core cache for max 2147483647 cores with initial capacity of 1024
bitnami-solr_1  | 2021-11-29 11:59:19.430 INFO  (main) [   ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
bitnami-solr_1  | 2021-11-29 11:59:19.489 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 11:59:19.490 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 11:59:19.491 INFO  (main) [   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@161479c6
bitnami-solr_1  | 2021-11-29 11:59:19.527 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /opt/bitnami/solr/server/solr
bitnami-solr_1  | 2021-11-29 11:59:19.578 INFO  (main) [   ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@2d901eb0{/solr,file:///opt/bitnami/solr/server/solr-webapp/webapp/,AVAILABLE}{/opt/bitnami/solr/server/solr-webapp/webapp}
bitnami-solr_1  | 2021-11-29 11:59:19.594 INFO  (main) [   ] o.e.j.s.AbstractConnector Started ServerConnector@7133da86{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8983}
bitnami-solr_1  | 2021-11-29 11:59:19.594 INFO  (main) [   ] o.e.j.s.Server Started @2238ms
Gracefully stopping... (press Ctrl+C again to force)
Stopping solr-debug_bitnami-solr_1 ... done             
                                                                                                                                                                                                                    
<path>\solr-debug>docker-compose up
Starting solr-debug_bitnami-solr_1 ... done                                                                                                                                                                                                                                 Attaching to solr-debug_bitnami-solr_1
bitnami-solr_1  | solr 11:59:46.23
bitnami-solr_1  | solr 11:59:46.23 Welcome to the Bitnami solr container
bitnami-solr_1  | solr 11:59:46.23 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-solr
bitnami-solr_1  | solr 11:59:46.24 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-solr/issues
bitnami-solr_1  | solr 11:59:46.24
bitnami-solr_1  | solr 11:59:46.24 INFO  ==> ** Starting solr setup **
bitnami-solr_1  | solr 11:59:46.25 INFO  ==> Validating settings in SOLR_* env vars...
bitnami-solr_1  | solr 11:59:46.25 INFO  ==> Initializing Solr ...
bitnami-solr_1  | solr 11:59:46.26 INFO  ==> Restoring persisted Solr installation
bitnami-solr_1  |
bitnami-solr_1  | solr 11:59:46.28 INFO  ==> ** solr setup finished! **
bitnami-solr_1  | solr 11:59:46.29 INFO  ==> ** Starting solr **
bitnami-solr_1  |
bitnami-solr_1  | Port 8983 is already being used by another process (pid: 88)
bitnami-solr_1  | Please choose a different port using the -p option.
bitnami-solr_1  |
solr-debug_bitnami-solr_1 exited with code 1

rosenbjerg avatar Nov 29 '21 12:11 rosenbjerg

Hi,

I think I found the issue. The issue appears when the container is killed and the PID file is not removed. In this situation the application incorrectly detects that Solr is running. I will open a task for checking this. Thanks for reporting!

javsalgar avatar Dec 07 '21 14:12 javsalgar

Hi @javsalgar Great that you found a promising root cause. I did take a peek inside the container after it had reached the state where it couldn't start the entrypoint. I coulnd't find any signs that a solr instance was running and didn't get any wiser. So it is great to hear that you found what could be the cause :)

rosenbjerg avatar Dec 07 '21 16:12 rosenbjerg

This Issue has been automatically marked as "stale" because it has not had recent activity (for 15 days). It will be closed if no further activity occurs. Thanks for the feedback.

github-actions[bot] avatar Dec 23 '21 01:12 github-actions[bot]

We are going to transfer this issue to bitnami/containers

In order to unify the approaches followed in Bitnami containers and Bitnami charts, we are moving some issues in bitnami/bitnami-docker-<container> repositories to bitnami/containers.

Please follow bitnami/containers to keep you updated about the latest bitnami images.

More information here: https://blog.bitnami.com/2022/07/new-source-of-truth-bitnami-containers.html

carrodher avatar Jul 28 '22 11:07 carrodher

Unfortunately, this issue was created a year ago and although there is an internal task to fix it, it was not prioritized as something to address in the short/mid term. It's not a technical reason but something related to the capacity since we're a small team.

Being said that, contributions via PRs are more than welcome in both repositories (containers and charts). Just in case you would like to contribute.

During this year, there are several releases of this asset and it's possible the issue has gone as part of other changes. If that's not the case and you are still experiencing this issue, please feel free to reopen it and we will re-evaluate it.

carrodher avatar Oct 20 '22 07:10 carrodher

I added a script to preStop in kubernetes to kill solr gracefully and it solved this problem you can see the script here: https://github.com/nazerise/solr/blob/main/templates/kill-solr.yaml

nazerise avatar Jan 24 '24 17:01 nazerise