out of memory errors

[ark]

I installed pentaho-demo (though there were some problems with startup scripts,
but i fixed those). Now i run 1.1.3 and constantly get out of memory errors:

2006-04-27 15:19:46,627 INFO [STDOUT] java.lang.OutOfMemoryError: PermGen space
2006-04-27 15:19:49,417 ERROR [org.apache.catalina.connector.CoyoteAdapter] An exception or error occurred in the container during the request processing
java.lang.OutOfMemoryError: PermGen space

and more like those (not just in CoyoteAdapter). There is about 1Gb of free physical
memory on the machine. Should i tweak jboss settings somehow?

[guzaldon]

yeah you'll need to tweak the jboss setting. jboss's site has a lot of good info on how to do it. But pretty much it's currently set at 512 meg for the -Xmx for the JVM.

Are you running this in windows or on linux?

also keep in mind there are some limits to how much memory you can allicate based on which OS you are using, unless it's Solaris then it's pretty much unlimit. but with windows you are probably limited to about 2GB and on linux depending on which flavor from 2GB to 4GB.

I hope that helps if you need more info I'll be happy to share what I know.

Have a good day and please drive through,

Nic

[mbatchelor]

To help you better, we need to know a little more about your application and how you're using the platform - what features of the platform you're using, what OS the platform is installed on, etc.

[ark]

Oops, forgot to mention, it is RHEL4 with generic Sun j2ee 1.4

[ark]

Looks like i found it, there is -Xmx128m which is definitely not enough even for demo applications ;-)

Thanks to everyone who helped.

[guzaldon]

I'm running on rhel 4 and have dealt with a lot of memory issues so I'll be helpy to share those experiences with you if you run acrost them. I ran into most of them when I was trying to do the ETL process with kettle. Mostly b/c I was not creating the transaction properly or trying to do too much in one. Kettle is a great addition to the pentaho project.

Glad we were able to help

Have a nice day,

Nic

[mores]

I am running pentaho_demo-1.1.4.239.

It looks like run.bat ( Windows )
set JAVA_OPTS=%JAVA_OPTS% -Xms128m -Xmx512m
run.conf ( Linux )
JAVA_OPTS="-server -Xms128m -Xmx128m"

Perhaps in the next release these values should match.

[mores]

It does not look like this made it into the 1.1.5 release.

Is there a bug database that I can submit this to ?

[mbatchelor]

We've got a case on it. Note however that this is a JBoss provided script file - that is, that's the default JBoss script that comes with JBoss 4.0.3.

However, since it's the PCI, we could certainly update it. I don't have a problem with doing that. But, I just wanted you to know that it's the stock file from JBoss.

Take care,

Marc

[hari_natarajan]

I get
java.lang.OutOfMemoryError: PermGen space
when i call the ad hoc report from my application.
However , running it seperately is just not a problem.
Am working on windows platform and the memory details are as follows
-J-Xms512m -J-Xmx768m -J-XX:PermSize=32m -J-XX:MaxPermSize=160m.
My system has a 2GB RAM.
Can anyone help me out on this issue?

[som banerjee]

Hi

I get the following error while trying to sort a table with 400K records and updating it into another table.

2010/11/10 15:03:32 - Table input.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : UnexpectedError:
2010/11/10 15:04:24 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : UnexpectedError:
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : java.lang.OutOfMemoryError: Java heap space
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : java.util.Arrays.copyOf(Arrays.java:2760)
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : java.util.Arrays.copyOf(Arrays.java:2734)
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : java.util.ArrayList.toArray(ArrayList.java:275)
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : java.util.Collections.sort(Collections.java:158)
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:568)
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:90)
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:408)
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : org.pentaho.di.trans.step.RunThread.run(RunThread.java:40)
2010/11/10 15:04:27 - Sort rows.0 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : java.lang.Thread.run(Thread.java:619)
2010/11/10 15:04:39 - pcard_tx_stage_1n2 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : Errors detected!
2010/11/10 15:04:39 - pcard_tx_stage_1n2 - ERROR (version 4.0.1-GA, build 13696 from 2010-07-30 11.43.59 by buildguy) : Errors detected!

Can any one please advice, how to increase the memory or a workaround

[DBA_Alex]

http://wiki.apache.org/tomcat/FAQ/Memory - You have to increase the memory set for Tomcat. After that, you should be good to go.

[som banerjee]

Thanks Alex, It was sorted by doing two things 1) Increase the memory of the java heap size (spoon.bat)
2) Putting a 10% free space in the sort file utility and limiting the rows to be held in memory for sorting.

Cheers
Som