PDA

View Full Version : Problem executing MapReduce Transformation Weblogs_parse_mr



Atilano
02-22-2012, 03:23 AM
Hi there!

I was following the tutorial throw the pentaho community and I runned into a problem while executing the examples.
I had no problems loadint the data into the hadoop cluster. But then when I followed the trasforming data step it crashed, and I really don´t know why. I´m using Apache Hadoop 0.20.2 so Kettle and PRD don´t need any configuration.

I paste below the log trace!
Hope I get some support of what's going on, thanks a lot!

2012/02/21 17:54:01 - Spoon - Iniciando trabajo...2012/02/21 17:54:01 - weblogs_parse_mr - Start of job execution
2012/02/21 17:54:01 - weblogs_parse_mr - exec(0, 0, START.0)
2012/02/21 17:54:01 - START - Starting job entry
2012/02/21 17:54:01 - weblogs_parse_mr - Starting entry [Pentaho MapReduce]
2012/02/21 17:54:01 - weblogs_parse_mr - exec(1, 0, Pentaho MapReduce.0)
2012/02/21 17:54:01 - Pentaho MapReduce - Starting job entry
2012/02/21 17:54:02 - Pentaho MapReduce - Using org.apache.hadoop.io.Text for the map output key
2012/02/21 17:54:02 - Pentaho MapReduce - Using org.apache.hadoop.io.Text for the map output value
2012/02/21 17:54:02 - Pentaho MapReduce - Configuring for Hadoop distribution: generic
2012/02/21 17:54:02 - Pentaho MapReduce - Cleaning output path: hdfs://localhost:9000/user/datienza/weblogs/parse
2012/02/21 17:54:03 - Pentaho MapReduce - Setup Complete: 0.0 Mapper Completion: 0.0 Reducer Completion: 0.0
2012/02/21 17:54:13 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
2012/02/21 17:54:13 - Pentaho MapReduce - [SUCCEEDED] -- Task: 4 Attempt: 0 Event: 0
2012/02/21 17:54:23 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 0 Attempt: 0 Event: 1
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 1 Attempt: 0 Event: 2
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
2012/02/21 17:54:23 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
2012/02/21 17:54:33 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 1 Attempt: 1 Event: 3
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 0 Attempt: 1 Event: 4
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
2012/02/21 17:54:33 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
2012/02/21 17:54:43 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 0 Attempt: 2 Event: 5
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName0(Native Method)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Class.forName(Class.java:264)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:790)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
2012/02/21 17:54:43 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
2012/02/21 17:54:53 - Pentaho MapReduce - Setup Complete: 100.0 Mapper Completion: 0.0 Reducer Completion: 0.0
2012/02/21 17:54:53 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 1 Attempt: 2 Event: 6
2012/02/21 17:54:53 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Error: java.lang.ClassNotFoundException: org.pentaho.di.trans.step.RowListener
2012/02/21 17:54:53 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
2012/02/21 17:54:53 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.security.AccessController.doPrivileged(Native Method)

Atilano
02-22-2012, 11:12 AM
Hi again! I solved it partialy! Now it says that error! maybe I missed something during installation!

2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Caused by: org.pentaho.di.core.exception.KettleException:
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Unable to read file '/opt/pentaho/pentaho-mapreduce/.kettle/kettle.properties'
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : /opt/pentaho/pentaho-mapreduce/.kettle/kettle.properties (No such file or directory)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) :
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.util.EnvUtil.readProperties(EnvUtil.java:65)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.util.EnvUtil.environmentInit(EnvUtil.java:95)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.KettleEnvironment.init(KettleEnvironment.java:65)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.KettleEnvironment.init(KettleEnvironment.java:53)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.hadoop.mapreduce.MRUtil.getTrans(MRUtil.java:73)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.hadoop.mapreduce.PentahoMapRunnable.createTrans(PentahoMapRunnable.java:178)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : ... 11 more
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Caused by: java.io.FileNotFoundException: /opt/pentaho/pentaho-mapreduce/.kettle/kettle.properties (No such file or directory)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.io.FileInputStream.open(Native Method)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.io.FileInputStream.<init>(FileInputStream.java:137)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.io.FileInputStream.<init>(FileInputStream.java:96)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.core.util.EnvUtil.readProperties(EnvUtil.java:60)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : ... 16 more
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : [FAILED] -- Task: 1 Attempt: 0 Event: 2
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : java.lang.RuntimeException: Error in configuring object
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.apache.hadoop.mapred.Child.main(Child.java:170)
2012/02/22 16:40:18 - Pentaho MapReduce - ERROR (version 4.3.0, build 1


Hope you can help me!

Thanks in advanced!

Atilano
02-22-2012, 11:34 AM
Finally I solved it! I found it throw another forum. You have to add the folder .kettle/kettle.properties to the pentaho-mapreduce directory.
It is a bug in the app!

Thanks any way!

Greets

jganoff
02-22-2012, 11:51 AM
Good catch Atilano! If the user the TaskTracker is run with has write access to the directory you configure when setting up pentaho.kettle.home in mapred-site.xml then the .kettle/kettle.properties should be created for you automatically. I'll update the instructions on the wiki (http://wiki.pentaho.com/display/BAD/Configure+Pentaho+for+Cloudera+and+Other+Hadoop+Versions).

Thanks!

sung101
02-22-2012, 11:59 AM
Thanks, Atilano, for helping us find a flaw in the doc.