PDA

View Full Version : NullPointerException during kettle mapreduce transformation reading hbase



markob
07-23-2013, 08:21 AM
Hello

When I submit (start) my Kettle job consisting of mapper and reducer transformation to hadoop cluster i get following exception logged during the mapper transformation (and the job fails):

java.lang.NullPointerException
at org.pentaho.hbase.mapred.PentahoTableRecordReaderImpl.restart(PentahoTableRecordReaderImpl.java:114)
at org.pentaho.hbase.mapred.PentahoTableRecordReader.init(PentahoTableRecordReader.java:72)
at org.apache.hadoop.hbase.mapred.TableInputFormatBase.getRecordReader(TableInputFormatBase.java:97)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:394)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)

This is line #114 from org.pentaho.hbase.mapred.PentahoTableRecordReaderImpl:
this.scanner = this.htable.getScanner(scan);

Seems that htable is null, ie. HTable handler is not obtained.
Should I add some jars to some folder or classpath somewhere?

Thanks