PDA

View Full Version : Kettle transformation from Text Input to HBase output - Mapping issue



manikandan.kannan
12-19-2012, 01:55 AM
I am trying to evaluate the Kettle integration with HBase and to start with, i tried the example at http://wiki.pentaho.com/display/BAD/Loading+Data+into+HBase with my changes in the load_hbase.ktr.

I use ubuntu 12.04 LTS, Kettle 4.3.0, HBase 0.96.0.

As i have issues in opening spoon on my ubuntu box, i create the job and transformations using spoon from windows.
But for the sake of example, i dont even do that as i use the already provided file.

I use pan.sh to run the transformation and i am getting the following exception
Problem getting mapping inforation: Mapping "weblogs,pageviews" does not exist!

From the other posts on the forum, i understand that the mapping needs to be created in Hbase manually.

My understanding is that when spoon is used to create the transformation, it automatically creates the mapping on HBase based on the values provided on the UI.
Can you please let me know how to create pentaho mapping in HBase without Spoon or any other UI (UI does not work on my Ubuntu box)?

dmoran
12-19-2012, 07:32 AM
I don't know how to do the mapping by hand but I think I have an answer for running spoon on Ubuntu 12.

Look at this wiki article:
http://wiki.pentaho.com/display/COM/PDI+with+Agile+BI+plug-in+on+Ubuntu+12

and related JIRA case:
http://jira.pentaho.com/browse/PDI-8430

Doug

mattb_pdi
12-20-2012, 10:13 AM
Can you verify with the HBase shell that the table and mapping exist? In the HBase shell you can use the describe command as follows (and you should get something similar to the output below):

hbase(main):012:0> describe "weblogs"
DESCRIPTION ENABLED
{NAME => 'weblogs', FAMILIES => [{NAME => 'pageviews', BLOOMFILTER => 'NONE', REPLI true
CATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647', B
LOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}

jesspinto
05-10-2013, 08:08 AM
Is it possible to do mapping by hand however?