Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Kettle is always crashing on one of the computers

  1. #1

    Default Kettle is always crashing on one of the computers

    Hi,

    by now, we are using a number of computers for testing and developing Kettle transformations. We have one PC running Windows XP SP3 with Java1.5.0_19, that is always crashing Kettle while running a transformation, that runs well on the others.

    I am attaching the log info.

    Hope someone can find the reason for our problems with this.

    Thanks

    Holger

    Code:
     
    #
    # An unexpected error has been detected by HotSpot Virtual Machine:
    #
    #  Internal Error (4E4D4554484F440E4350500529), pid=316, tid=5820
    #
    # Java VM: Java HotSpot(TM) Client VM (1.5.0_19-b02 mixed mode)
    ---------------  T H R E A D  ---------------
    Current thread (0x037eda30):  JavaThread "IN_PP_TELEKOMADRESSE.0 (Thread-17)" [_thread_in_Java, id=5820]
    Stack: [0x074a0000,0x074e0000),  sp=0x074df0bc,  free space=252k
    Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
    V  [jvm.dll+0x125406]
    V  [jvm.dll+0x63af0]
    V  [jvm.dll+0xd7eb8]
    V  [jvm.dll+0xf888a]
    V  [jvm.dll+0xde8a1]
    V  [jvm.dll+0xe000e]
    V  [jvm.dll+0x87582]
    V  [jvm.dll+0x872df]
    V  [jvm.dll+0xa2131]
    V  [jvm.dll+0x111949]
    V  [jvm.dll+0x111917]
    C  [MSVCRT.dll+0x2a3b0]
    C  [kernel32.dll+0xb729]
     
    ---------------  P R O C E S S  ---------------
    Java Threads: ( => current thread )
      0x03a8cd20 JavaThread "Java2D Disposer" daemon [_thread_blocked, id=4380]
      0x0319f5a0 JavaThread "AWT-Windows" daemon [_thread_in_native, id=4840]
      0x0382eea8 JavaThread "Timer-3" [_thread_blocked, id=5392]
      0x0319d408 JavaThread "Timer-2" [_thread_blocked, id=4608]
      0x03a54ab0 JavaThread "[[PP_TELEKOMC].[Mapping (sub-transformation)].DATEN_ZP_ERMITTELN].Mapping output specification.0 (Thread-35)" [_thread_blocked, id=4460]
      0x03a54010 JavaThread "Get Variables" [_thread_blocked, id=176]
      0x03a22a18 JavaThread "[[PP_TELEKOMC].[Mapping (sub-transformation)].DATEN_ZP_ERMITTELN].Join Rows (cartesian product) 2.0 (Thread-31)" [_thread_in_vm, id=2924]
      0x03a21e30 JavaThread "[[PP_TELEKOMC].[Mapping (sub-transformation)].DATEN_ZP_ERMITTELN].Mapping input specification.0 (Thread-30)" [_thread_blocked, id=4384]
      0x03a21310 JavaThread "[[PP_TELEKOMC].[Mapping (sub-transformation)].DATEN_ZP_ERMITTELN].Dummy (do nothing).0 (Thread-29)" [_thread_blocked, id=5628]
      0x03a91008 JavaThread "[[PP_TELEKOMC].[Mapping (sub-transformation)].DATEN_ZP_ERMITTELN].Modified Java Script Value.0 (Thread-28)" [_thread_blocked, id=5664]
    =>0x037eda30 JavaThread "IN_PP_TELEKOMADRESSE.0 (Thread-17)" [_thread_in_Java, id=5820]
      0x037ed8a8 JavaThread "NUMMERADRESSE.0 (Thread-16)" [_thread_blocked, id=2244]
      0x037ed720 JavaThread "OUT_PP_TELEKOMADRESSE.0 (Thread-15)" [_thread_blocked, id=2640]
      0x037ed598 JavaThread "If field value is null.0 (Thread-14)" [_thread_blocked, id=4992]
      0x039c1e10 JavaThread "Merge Join.0 (Thread-13)" [_thread_blocked, id=5932]
      0x031d4cd0 JavaThread "Dummy (do nothing).0 (Thread-12)" [_thread_blocked, id=4304]
      0x031d1008 JavaThread "Select values 2.0 (Thread-11)" [_thread_blocked, id=5444]
      0x039bf3f8 JavaThread "Add sequence.0 (Thread-10)" [_thread_in_native, id=5792]
      0x037ed410 JavaThread "Mapping (sub-transformation).0 (Thread-9)" [_thread_blocked, id=1288]
      0x039c1af8 JavaThread "Unique rows.0 (Thread-8)" [_thread_blocked, id=5460]
      0x039bf580 JavaThread "Timer-1" [_thread_blocked, id=5832]
      0x0375cd98 JavaThread "TransGraph: PP_TELEKOMC" [_thread_blocked, id=2064]
      0x0382af20 JavaThread "Thread-4" [_thread_blocked, id=5728]
      0x0385dc80 JavaThread "Timer-0" [_thread_blocked, id=2904]
      0x00acbd40 JavaThread "org.apache.commons.vfs.cache.SoftRefFilesCache$SoftRefReleaseThread" daemon [_thread_blocked, id=4544]
      0x00a95e30 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=5360]
      0x00a94aa8 JavaThread "CompilerThread0" daemon [_thread_blocked, id=4560]
      0x00a93e10 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=856]
      0x00a8ac48 JavaThread "Finalizer" daemon [_thread_blocked, id=4144]
      0x00a89810 JavaThread "Reference Handler" daemon [_thread_blocked, id=6124]
      0x00386b58 JavaThread "main" [_thread_in_native, id=4908]
    Other Threads:
      0x00a48450 VMThread [id=880]
      0x00a93cb8 WatcherThread [id=5536]
    VM state:not at safepoint (normal execution)
    VM Mutex/Monitor currently owned by a thread: None
    Heap
     def new generation   total 5120K, used 3521K [0x10010000, 0x10590000, 0x16410000)
      eden space 4608K,  68% used [0x10010000, 0x10321288, 0x10490000)
      from space 512K,  74% used [0x10490000, 0x104ef300, 0x10510000)
      to   space 512K,   0% used [0x10510000, 0x10510000, 0x10590000)
     tenured generation   total 65900K, used 57337K [0x16410000, 0x1a46b000, 0x61410000)
       the space 65900K,  87% used [0x16410000, 0x19c0e440, 0x19c0e600, 0x1a46b000)
     compacting perm gen  total 27136K, used 26938K [0x61410000, 0x62e90000, 0x65410000)
       the space 27136K,  99% used [0x61410000, 0x62e5e930, 0x62e5ea00, 0x62e90000)
    No shared spaces configured.
    Dynamic libraries:
    0x00400000 - 0x0040d000  C:\Programme\Java\jre1.5.0_19\bin\javaw.exe
    0x7c910000 - 0x7c9c9000  C:\WINDOWS\system32\ntdll.dll
    0x7c800000 - 0x7c908000  C:\WINDOWS\system32\kernel32.dll
    0x77da0000 - 0x77e4a000  C:\WINDOWS\system32\ADVAPI32.dll
    0x77e50000 - 0x77ee2000  C:\WINDOWS\system32\RPCRT4.dll
    0x77fc0000 - 0x77fd1000  C:\WINDOWS\system32\Secur32.dll
    0x7e360000 - 0x7e3f1000  C:\WINDOWS\system32\USER32.dll
    0x77ef0000 - 0x77f39000  C:\WINDOWS\system32\GDI32.dll
    0x77be0000 - 0x77c38000  C:\WINDOWS\system32\MSVCRT.dll
    0x10000000 - 0x1000b000  C:\PROGRA~1\NetInst\NiAMH.dll
    0x6d640000 - 0x6d7de000  C:\Programme\Java\jre1.5.0_19\bin\client\jvm.dll
    0x76af0000 - 0x76b1e000  C:\WINDOWS\system32\WINMM.dll
    0x6d290000 - 0x6d298000  C:\Programme\Java\jre1.5.0_19\bin\hpi.dll
    0x76bb0000 - 0x76bbb000  C:\WINDOWS\system32\PSAPI.DLL
    0x6d610000 - 0x6d61c000  C:\Programme\Java\jre1.5.0_19\bin\verify.dll
    0x6d310000 - 0x6d32d000  C:\Programme\Java\jre1.5.0_19\bin\java.dll
    0x6d630000 - 0x6d63f000  C:\Programme\Java\jre1.5.0_19\bin\zip.dll
    0x03f30000 - 0x03f7f000  T:\Temp\swt-win32-3346.dll
    0x774b0000 - 0x775ed000  C:\WINDOWS\system32\ole32.dll
    0x773a0000 - 0x774a3000  C:\WINDOWS\WinSxS\X86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.2600.5512_x-ww_35d4ce83\COMCTL32.dll
    0x77f40000 - 0x77fb6000  C:\WINDOWS\system32\SHLWAPI.dll
    0x76350000 - 0x7639a000  C:\WINDOWS\system32\comdlg32.dll
    0x7e670000 - 0x7ee91000  C:\WINDOWS\system32\SHELL32.dll
    0x770f0000 - 0x7717b000  C:\WINDOWS\system32\OLEAUT32.dll
    0x76330000 - 0x7634d000  C:\WINDOWS\system32\IMM32.dll
    0x75790000 - 0x757fb000  C:\WINDOWS\system32\USP10.dll
    0x77180000 - 0x7722b000  C:\WINDOWS\system32\WININET.dll
    0x77a50000 - 0x77ae6000  C:\WINDOWS\system32\CRYPT32.dll
    0x77af0000 - 0x77b02000  C:\WINDOWS\system32\MSASN1.dll
    0x03f90000 - 0x0402a000  C:\WINDOWS\system32\comctl32.dll
    0x04070000 - 0x040a8000  C:\WINDOWS\system32\uxtheme.dll
    0x746a0000 - 0x746ec000  C:\WINDOWS\system32\MSCTF.dll
    0x04280000 - 0x0428e000  C:\Programme\Hardcopy\hcdll2.dll
    0x68000000 - 0x68036000  C:\WINDOWS\system32\rsaenh.dll
    0x76620000 - 0x766d6000  C:\WINDOWS\system32\USERENV.dll
    0x043f0000 - 0x04445000  C:\WINDOWS\system32\netapi32.dll
    0x6d4d0000 - 0x6d4e3000  C:\Programme\Java\jre1.5.0_19\bin\net.dll
    0x71a10000 - 0x71a27000  C:\WINDOWS\system32\WS2_32.dll
    0x71a00000 - 0x71a08000  C:\WINDOWS\system32\WS2HELP.dll
    0x719b0000 - 0x719f0000  C:\WINDOWS\System32\mswsock.dll
    0x76ee0000 - 0x76f07000  C:\WINDOWS\system32\DNSAPI.dll
    0x76f70000 - 0x76f78000  C:\WINDOWS\System32\winrnr.dll
    0x76f20000 - 0x76f4d000  C:\WINDOWS\system32\WLDAP32.dll
    0x76f80000 - 0x76f86000  C:\WINDOWS\system32\rasadhlp.dll
    0x76320000 - 0x76325000  C:\WINDOWS\system32\msimg32.dll
    0x05140000 - 0x05154000  T:\Temp\swt-gdip-win32-3346.dll
    0x05160000 - 0x05306000  C:\WINDOWS\WinSxS\x86_Microsoft.Windows.GdiPlus_6595b64144ccf1df_1.0.2600.5581_x-ww_dfbc4fc4\gdiplus.dll
    0x74c00000 - 0x74c2c000  C:\WINDOWS\system32\oleacc.dll
    0x76020000 - 0x76085000  C:\WINDOWS\system32\MSVCP60.dll
    0x76f90000 - 0x7700f000  C:\WINDOWS\system32\CLBCATQ.DLL
    0x77010000 - 0x770e3000  C:\WINDOWS\system32\COMRes.dll
    0x77bd0000 - 0x77bd8000  C:\WINDOWS\system32\VERSION.dll
    0x7e1e0000 - 0x7e351000  C:\WINDOWS\system32\shdocvw.dll
    0x76880000 - 0x76905000  C:\WINDOWS\system32\CRYPTUI.dll
    0x76bf0000 - 0x76c1e000  C:\WINDOWS\system32\WINTRUST.dll
    0x76c50000 - 0x76c78000  C:\WINDOWS\system32\IMAGEHLP.dll
    0x77b10000 - 0x77b32000  C:\WINDOWS\system32\appHelp.dll
    0x76970000 - 0x76a21000  C:\WINDOWS\system32\SXS.DLL
    0x06520000 - 0x067f9000  C:\WINDOWS\system32\xpsp2res.dll
    0x7d1f0000 - 0x7d4ac000  C:\WINDOWS\system32\msi.dll
    0x778f0000 - 0x779e4000  C:\WINDOWS\system32\SETUPAPI.dll
    0x7df20000 - 0x7dfc2000  C:\WINDOWS\system32\urlmon.dll
    0x71800000 - 0x7188e000  C:\WINDOWS\system32\shdoclc.dll
    0x75dc0000 - 0x75e51000  C:\WINDOWS\system32\mlang.dll
    0x7dbe0000 - 0x7ded8000  C:\WINDOWS\system32\mshtml.dll
    0x74640000 - 0x74667000  C:\WINDOWS\system32\msls31.dll
    0x06db0000 - 0x06e09000  C:\WINDOWS\system32\hnetcfg.dll
    0x719f0000 - 0x719f8000  C:\WINDOWS\System32\wshtcpip.dll
    0x06e90000 - 0x06e9c000  C:\WINDOWS\system32\ImgUtil.dll
    0x06eb0000 - 0x06ebc000  C:\WINDOWS\system32\pngfilt.dll
    0x07080000 - 0x0708d000  C:\Programme\Hardcopy\hardcopy.dll
    0x6d000000 - 0x6d170000  C:\Programme\Java\jre1.5.0_19\bin\awt.dll
    0x72f70000 - 0x72f96000  C:\WINDOWS\system32\WINSPOOL.DRV
    0x736d0000 - 0x7371b000  C:\WINDOWS\system32\ddraw.dll
    0x73b30000 - 0x73b36000  C:\WINDOWS\system32\DCIMAN32.dll
    0x6d240000 - 0x6d290000  C:\Programme\Java\jre1.5.0_19\bin\fontmanager.dll
    0x6d1c0000 - 0x6d1e3000  C:\Programme\Java\jre1.5.0_19\bin\dcpr.dll
    0x6d4f0000 - 0x6d4f9000  C:\Programme\Java\jre1.5.0_19\bin\nio.dll
    VM Arguments:
    jvm_args: -Xmx1300M -DKETTLE_HOME= -DKETTLE_REPOSITORY= -DKETTLE_USER= -DKETTLE_PASSWORD= -DKETTLE_PLUGIN_PACKAGES= -DKETTLE_LOG_SIZE_LIMIT=
    java_command: C:\Programme\Kettle_3.2.0_stable\data-integration\launcher\launcher-1.0.0.jar
    Launcher Type: SUN_STANDARD
    Environment Variables:
    JAVA_HOME=C:\Programme\Java\jdk1.5.0_15
    CLASSPATH=.;C:\PROGRA~1\IBM\SQLLIB\java\db2java.zip;C:\PROGRA~1\IBM\SQLLIB\java\db2jcc.jar;C:\PROGRA~1\IBM\SQLLIB\java\sqlj.zip;C:\PROGRA~1\IBM\SQLLIB\java\DB2JCC~1.JAR;C:\PROGRA~1\IBM\SQLLIB\BIN;C:\PROGRA~1\IBM\SQLLIB\java\Common.jar
    PATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\PROGRA~1\DeskView\system;C:\Programme\Subversion\bin;C:\PROGRA~1\IBM\SQLLIB\BIN;C:\PROGRA~1\IBM\SQLLIB\FUNCTION;C:\PROGRA~1\IBM\SQLLIB\SAMPLES\REPL;C:\Programme\Informix\Client-SDK\bin;C:\Programme\Java\jdk1.5.0_15\bin;\bin
    USERNAME=raer
    OS=Windows_NT
    PROCESSOR_IDENTIFIER=x86 Family 15 Model 4 Stepping 4, GenuineIntel
     
    ---------------  S Y S T E M  ---------------
    OS: Windows XP Build 2600 Service Pack 3
    CPU:total 2 (cores per cpu 2, threads per core 1) family 15 model 4 stepping 4, cmov, cx8, fxsr, mmx, sse, sse2, sse3
    Memory: 4k page, physical 2095532k(1102888k free), swap 4194303k(4194303k free)
    vm_info: Java HotSpot(TM) Client VM (1.5.0_19-b02) for windows-x86, built on May  4 2009 09:51:54 by "java_re" with MS VC++ 6.0
    time: Tue Jul 14 12:26:12 2009
    elapsed time: 324 seconds

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    I don't see anything specific in the trace. Could this be a JVM bug somehow? Compare 1.5.0_19-b02 with the JVM versions on your other systems.

  3. #3

    Default

    AFTER checking the JVM's on the other machines (making sure to compare apples to apples)

    -bad physical memory, or not enough physical memory (remember, your Xmx plus your Permgen is the total physical memory needed, not just the Xmx). Based on the log below, there seems to be enough physical memory.

    based on: compacting perm gen total 27136K, used 26938K [0x61410000, 0x62e90000, 0x65410000)
    the space 27136K, 99% used [0x61410000, 0x62e5e930, 0x62e5ea00, 0x62e90000)

    Add JVM/JAVA_OPTS flag '-XX:MaxPermSize=512m', but this should have given an OutOfMemory: PermGen error instead of just crashing.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.