Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Starting Pentaho on a micro AWS server - Process dies abruptly during start up

  1. #1
    Join Date
    Apr 2012
    Posts
    2

    Default Starting Pentaho on a micro AWS server - Process dies abruptly during start up

    Hi,

    I was really hoping to figure this one out but I can't find anything anywhere and the logs don't seem to point me in the right direction. I'm not sure whether this is a Pentaho of AWS issue.

    So here goes:

    Pentaho version 3.10
    Ubuntu version 11:10

    Extracted bi server under pentaho users home directory.

    Opened the following ports in security groups in the AWS console:

    22 (SSH)
    80 (HTTP)
    443 (HTTPS)
    3306 (MYSQL)
    8005
    8009
    8080 (HTTP*)
    8081
    8088
    9001

    Started pentaho:
    ~/biserver-ce$ ./start-pentaho.sh
    /home/pentaho/biserver-ce
    /home/pentaho/biserver-ce
    DEBUG: Using JAVA_HOME
    DEBUG: _PENTAHO_JAVA_HOME=/usr/lib/jvm/java-6-sun
    DEBUG: _PENTAHO_JAVA=/usr/lib/jvm/java-6-sun/bin/java
    Using CATALINA_BASE: /home/pentaho/biserver-ce/tomcat
    Using CATALINA_HOME: /home/pentaho/biserver-ce/tomcat
    Using CATALINA_TMPDIR: /home/pentaho/biserver-ce/tomcat/temp
    Using JRE_HOME: /usr/lib/jvm/java-6-sun
    Using CLASSPATH: /home/pentaho/biserver-ce/tomcat/bin/bootstrap.jar


    I'm tailing the catalina.out log, process checking under pentaho and doing a netstat to check the ports are listening:

    Catalina.out

    Apr 5, 2012 1:44:26 PM org.apache.catalina.core.AprLifecycleListener init
    INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/lib /jvm/java-6-sun-1.6.0.26/jre/lib/amd64/server:/usr/lib/jvm/java-6-sun-1.6.0.26/jre/lib/amd64:/usr/lib/jvm/java-6-sun-1.6.0.26/jre/../lib/amd64:/usr/java/pack ages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
    Apr 5, 2012 1:44:27 PM org.apache.coyote.http11.Http11Protocol init
    INFO: Initializing Coyote HTTP/1.1 on http-8081
    Apr 5, 2012 1:44:27 PM org.apache.catalina.startup.Catalina load
    INFO: Initialization processed in 1060 ms
    Apr 5, 2012 1:44:27 PM org.apache.catalina.core.StandardService start
    INFO: Starting service Catalina
    Apr 5, 2012 1:44:27 PM org.apache.catalina.core.StandardEngine start
    INFO: Starting Servlet Engine: Apache Tomcat/6.0.29
    Apr 5, 2012 1:44:27 PM org.apache.catalina.startup.HostConfig deployDescriptor
    INFO: Deploying configuration descriptor pentaho.xml
    Apr 5, 2012 1:44:28 PM org.apache.catalina.startup.ContextConfig validateSecurit
    INFO: WARNING: Security role name PENTAHO_ADMIN used in an <auth-constraint> wit
    [Server@494eaec9]: [Thread[main,5,main]]: checkRunning(false) entered
    [Server@494eaec9]: [Thread[main,5,main]]: checkRunning(false) exited
    [Server@494eaec9]: Initiating startup sequence...
    [Server@494eaec9]: Server socket opened successfully in 1 ms.
    [Server@494eaec9]: Database [index=0, id=0, db=file:../../data/hsqldb/sampledata
    [Server@494eaec9]: Database [index=1, id=1, db=file:../../data/hsqldb/hibernate,
    [Server@494eaec9]: Database [index=2, id=2, db=file:../../data/hsqldb/quartz, al
    [Server@494eaec9]: Startup sequence completed in 3672 ms.
    [Server@494eaec9]: 2012-04-05 13:44:34.707 HSQLDB server 1.8.0 is online
    [Server@494eaec9]: To close normally, connect and execute SHUTDOWN SQL
    [Server@494eaec9]: From command line, use [Ctrl]+[C] to abort abruptly
    13:47:42,505 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:43,741 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:43,953 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:44,722 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:46,066 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:46,828 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:47,360 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:48,024 WARN [DefaultSchemaGenerator] We don't support method overloading. Ignoring [public java.lang.String serializeModels(org.pentaho.metadata.model.Domain,java.lang.String,boolean) throws java.lang.Exception]
    13:47:48,097 WARN [DefaultSchemaGenerator] We don't support method overloading. Ignoring [public java.lang.String serializeModels(org.pentaho.metadata.model.Domain,java.lang.String,boolean) throws java.lang.Exception]
    13:47:48,139 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:48,755 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:49,176 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:49,356 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:49,594 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:50,177 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:51,207 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:51,752 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:52,153 WARN [AxisService] Unable to generate EPR for the transport : http
    Warning: Running an XSLT 1.0 stylesheet with an XSLT 2.0 processor
    13:47:52,779 WARN [DefaultSchemaGenerator] We don't support method overloading. Ignoring [public java.lang.String serializeModels(org.pentaho.metadata.model.Domain,java.lang.String,boolean) throws java.lang.Exception]
    13:47:52,840 WARN [DefaultSchemaGenerator] We don't support method overloading. Ignoring [public java.lang.String serializeModels(org.pentaho.metadata.model.Domain,java.lang.String,boolean) throws java.lang.Exception]
    13:47:52,867 WARN [AxisService] Unable to generate EPR for the transport : http

    (Note it has actually got to the point where it says the pentaho server is ready and then the process has died so it not consistent.)

    Once minute it's looking fine:

    ps -ef |grep pentaho

    pentaho 2121 1160 0 10:53 pts/0 00:00:00 su - pentaho
    pentaho 2128 2121 0 10:53 pts/0 00:00:05 -su
    pentaho 2425 2364 0 10:55 pts/2 00:00:00 su - pentaho
    pentaho 2432 2425 0 10:55 pts/2 00:00:01 -su
    pentaho 3182 1 0 10:59 ? 00:00:00 /usr/bin/pulseaudio --start --log-target=syslog
    pentaho 3187 3182 0 10:59 ? 00:00:00 /usr/lib/pulseaudio/pulse/gconf-helper
    pentaho 5154 5099 0 13:43 pts/1 00:00:00 su - pentaho
    pentaho 5161 5154 0 13:43 pts/1 00:00:00 -su
    pentaho 5272 5161 0 13:43 pts/1 00:00:00 tail -f catalina.out
    pentaho 5290 1 92 13:44 pts/0 00:00:40 /usr/lib/jvm/java-6-sun/bin/java -Djava.util.logging.config.file=/home/pentaho/biserver-ce/tomcat/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Xms256m -Xmx768m -XX:MaxPermSize=256m -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.endorsed.dirs=/home/pentaho/biserver-ce/tomcat/endorsed -classpath /home/pentaho/biserver-ce/tomcat/bin/bootstrap.jar -Dcatalina.base=/home/pentaho/biserver-ce/tomcat -Dcatalina.home=/home/pentaho/biserver-ce/tomcat -Djava.io.tmpdir=/home/pentaho/biserver-ce/tomcat/temp org.apache.catalina.startup.Bootstrap start
    pentaho 5303 2128 0 13:45 pts/0 00:00:00 ps -ef
    pentaho 5304 2128 0 13:45 pts/0 00:00:00 grep --color=auto pentaho

    netstat -natlp

    (Not all processes could be identified, non-owned process info
    will not be shown, you would have to be root to see it all.)
    Active Internet connections (servers and established)
    Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
    tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN -
    tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN -
    tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN -
    tcp 0 480 10.229.78.133:22 194.237.142.3:52165 ESTABLISHED -
    tcp 0 0 10.229.78.133:22 194.237.142.3:49251 ESTABLISHED -
    tcp 0 0 10.229.78.133:22 194.237.142.3:28226 ESTABLISHED -
    tcp6 0 0 :::8081 :::* LISTEN 4659/java
    tcp6 0 0 :::22 :::* LISTEN -
    tcp6 0 0 ::1:631 :::* LISTEN -
    tcp6 0 0 :::9001 :::* LISTEN 4659/java
    tcp6 0 0 127.0.0.1:9001 127.0.0.1:57715 ESTABLISHED 4659/java
    tcp6 0 0 127.0.0.1:9001 127.0.0.1:57718 ESTABLISHED 4659/java
    tcp6 0 0 127.0.0.1:9001 127.0.0.1:57713 ESTABLISHED 4659/java
    tcp6 0 0 127.0.0.1:9001 127.0.0.1:57716 ESTABLISHED 4659/java
    tcp6 0 0 127.0.0.1:9001 127.0.0.1:57717 ESTABLISHED 4659/java
    tcp6 0 0 127.0.0.1:57718 127.0.0.1:9001 ESTABLISHED 4659/java
    tcp6 0 0 127.0.0.1:57715 127.0.0.1:9001 ESTABLISHED 4659/java
    tcp6 0 0 127.0.0.1:57717 127.0.0.1:9001 ESTABLISHED 4659/java
    tcp6 0 0 127.0.0.1:57716 127.0.0.1:9001 ESTABLISHED 4659/java
    tcp6 0 0 127.0.0.1:57714 127.0.0.1:9001 TIME_WAIT -
    tcp6 0 0 127.0.0.1:57713 127.0.0.1:9001 ESTABLISHED 4659/java

    The next the whole thing has just died.

    ps -ef |grep pentaho

    pentaho 2121 1160 0 10:53 pts/0 00:00:00 su - pentaho
    pentaho 2128 2121 0 10:53 pts/0 00:00:05 -su
    pentaho 2425 2364 0 10:55 pts/2 00:00:00 su - pentaho
    pentaho 2432 2425 0 10:55 pts/2 00:00:01 -su
    pentaho 3182 1 0 10:59 ? 00:00:00 /usr/bin/pulseaudio --start --log-target=syslog
    pentaho 3187 3182 0 10:59 ? 00:00:00 /usr/lib/pulseaudio/pulse/gconf-helper
    pentaho 5154 5099 0 13:43 pts/1 00:00:00 su - pentaho
    pentaho 5161 5154 0 13:43 pts/1 00:00:00 -su
    pentaho 5272 5161 0 13:43 pts/1 00:00:00 tail -f catalina.out
    pentaho 5360 2128 0 14:00 pts/0 00:00:00 ps -ef
    pentaho 5361 2128 0 14:00 pts/0 00:00:00 grep --color=auto pentaho



    netstat -natlp
    (Not all processes could be identified, non-owned process info
    will not be shown, you would have to be root to see it all.)
    Active Internet connections (servers and established)
    Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
    tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN -
    tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN -
    tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN -
    tcp 0 480 10.229.78.133:22 194.237.142.3:52165 ESTABLISHED -
    tcp 0 0 10.229.78.133:22 194.237.142.3:28226 ESTABLISHED -
    tcp 0 0 10.229.78.133:22 194.237.142.3:46489 ESTABLISHED -
    tcp6 0 0 :::22 :::* LISTEN -
    tcp6 0 0 ::1:631 :::* LISTEN -


    I assume it's either a java memory issue or a operating system resource issue but I have nothing to go on to determine where the problem lies and I can't find anyone with a similar problem online.

    Help!!

  2. #2
    Join Date
    Apr 2012
    Posts
    2

    Default

    Found this in the syslog which explains a lot!

    Apr 5 15:28:46 ip-10-229-78-133 kernel: [ 4707.867564] Out of memory: Kill process 2112 (java) score 851 or sacrifice child
    Apr 5 15:28:46 ip-10-229-78-133 kernel: [ 4707.867597] Killed process 2112 (java) total-vm:1591284kB, anon-rss:514776kB, file-rss:0kB

    Now the question is is this a hardware capacity issue or a memory leak?

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.