PDA

View Full Version : Creating mapper and reducer transformations from a Kettle HBase aggregation workflow



markob
06-07-2013, 09:53 AM
Hello,

I have an existing working Kettle workflow that reads some table from HBase and aggregates it by some field. I would like to convert it to mapper and reducer transformation. The major issue that makes the workflow look awkward is the need to filtrate out specific fields prior to calculating the average. Obviously I missed the mapreduce concept, due to lack of documentation. The workflow and attempts of mapper and reducer transformations are attached. Thank you for any suggestions.

Regards