Hitachi Vantara Pentaho Community Forums
Results 1 to 10 of 10

Thread: Problem executing MapReduce Transformation Weblogs_parse_mr

  1. #1
    Join Date
    Feb 2012
    Posts
    3

    Default Problem executing MapReduce Transformation Weblogs_parse_mr

    Hi there!

    I was following the tutorial throw the pentaho community and I runned into a problem while executing the examples.
    I had no problems loadint the data into the hadoop cluster. But then when I followed the trasforming data step it crashed, and I really don´t know why. I´m using Apache Hadoop 0.20.2 so Kettle and PRD don´t need any configuration.

    I paste below the log trace!
    Hope I get some support of what's going on, thanks a lot!

    2012/02/21 17:54:01 - Spoon - Iniciando trabajo...2012/02/21 17:54:01 - weblogs_parse_mr - Start of job execution
    2012/02/21 17:54:01 - weblogs_parse_mr - exec(0, 0, START.0)
    2012/02/21 17:54:01 - START - Starting job entry
    2012/02/21 17:54:01 - weblogs_parse_mr - Starting entry [Pentaho MapReduce]
    2012/02/21 17:54:01 - weblogs_parse_mr - exec(1, 0, Pentaho MapReduce.0)
    2012/02/21 17:54:01 - Pentaho MapReduce - Starting job entry
    2012/02/21 17:54:02 - Pentaho MapReduce - Using org.apache.hadoop.io.Text for the map output key
    2012/02/21 17:54:02 - Pentaho MapReduce - Using org.apache.hadoop.io.Text for the map output value
    2012/02/21 17:54:02 - Pentaho MapReduce - Configuring for Hadoop distribution: generic
    2012/02/21 17:54:02 - Pentaho MapReduce - Cleaning output path: hdfs://localhost:9000/user/datienza/weblogs/parse
    2012/02/21 17:54:03 - Pentaho MapReduce - Setup Complete: 0.0 Mapper Completion: 0.0 Reducer Completion: 0.0
    2012/02/21 17:54:13 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
    2012/02/21 17:54:13 - Pentaho MapReduce - [SUCCEEDED] -- Task: 4 Attempt: 0 Event: 0
    2012/02/21 17:54:23 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 0 Attempt: 0 Event: 1
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 1 Attempt: 0 Event: 2
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
    2012/02/21 17:54:33 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 1 Attempt: 1 Event: 3
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 0 Attempt: 1 Event: 4
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
    2012/02/21 17:54:43 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 0 Attempt: 2 Event: 5
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
    2012/02/21 17:54:53 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
    2012/02/21 17:54:53 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 1 Attempt: 2 Event: 6
    2012/02/21 17:54:53 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
    2012/02/21 17:54:53 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    2012/02/21 17:54:53 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)

  2. #2
    Join Date
    Feb 2012
    Posts
    3

    Default

    Hi again! I solved it partialy! Now it says that error! maybe I missed something during installation!

    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Caused by: org.pentaho.di.core.exception.KettleException:
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Unable to read file '/opt/pentaho/pentaho-mapreduce/.kettle/kettle.properties'
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : /opt/pentaho/pentaho-mapreduce/.kettle/kettle.properties (No such file or directory)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) :
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.util.EnvUtil.readProperties(EnvUtil.java:65)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.util.EnvUtil.environmentInit(EnvUtil.java:95)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.KettleEnvironment.init(KettleEnvironment.java:65)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.KettleEnvironment.init(KettleEnvironment.java:53)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.hadoop.mapreduce.MRUtil.getTrans(MRUtil.java:73)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.hadoop.mapreduce.PentahoMapRunnable.createTrans(PentahoMapRunnable.java:178)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : ... 11 more
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Caused by: java.io.FileNotFoundException: /opt/pentaho/pentaho-mapreduce/.kettle/kettle.properties (No such file or directory)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.io.FileInputStream.open(Native Method)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.io.FileInputStream.<init>(FileInputStream.java:137)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.io.FileInputStream.<init>(FileInputStream.java:96)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.util.EnvUtil.readProperties(EnvUtil.java:60)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : ... 16 more
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 1 Attempt: 0 Event: 2
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : java.lang.RuntimeException: Error in configuring object
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
    2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 1


    Hope you can help me!

    Thanks in advanced!

  3. #3
    Join Date
    Feb 2012
    Posts
    3

    Default

    Finally I solved it! I found it throw another forum. You have to add the folder .kettle/kettle.properties to the pentaho-mapreduce directory.
    It is a bug in the app!

    Thanks any way!

    Greets

  4. #4
    Join Date
    Aug 2010
    Posts
    87

    Default

    Good catch Atilano! If the user the TaskTracker is run with has write access to the directory you configure when setting up pentaho.kettle.home in mapred-site.xml then the .kettle/kettle.properties should be created for you automatically. I'll update the instructions on the wiki.

    Thanks!
    Last edited by jganoff; 02-23-2012 at 09:49 AM.

  5. #5
    Join Date
    Feb 2012
    Posts
    1

    Default

    Thanks, Atilano, for helping us find a flaw in the doc.

  6. #6
    Join Date
    Sep 2013
    Posts
    15

    Default

    Hi Atilano, Can you please confirm how did you resolve this issue? I am also facing the same issue. Appreciate it if you can let me know how to resolve this issue.

  7. #7
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    He did it the way he said in his post above, by creating the folder Kettle complains about not finding.

  8. #8
    Join Date
    Sep 2013
    Posts
    15

    Default

    Hi Matt, Actually his first issue is about Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener. What folder should I create to resolve this issue?

  9. #9
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    See the other thread.

  10. #10
    Join Date
    Jun 2014
    Posts
    3

    Default

    Quote Originally Posted by ktadikamalla View Post
    Hi Matt, Actually his first issue is about Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener. What folder should I create to resolve this issue?
    I was experiencing a similar case and I got this solved by changing the classpath separator in spoon.sh: OPT="$OPT ... -Dhadoop.cluster.path.separator=,"

    Hope this help.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.