Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Looking documentaion of Hadoop Integration

  1. #1
    Join Date
    Oct 2010
    Posts
    3

    Default Looking documentaion of Hadoop Integration

    Hello,

    I ran into the following Pentaho Road show on Hadoop.
    http://vimeo.com/14641559

    I am working on a project where we are going to use both PDI and Hadoop. I am looking for some guideline and documentation on to integrate PDI on Hadoop.

    Thanks

  2. #2

    Default

    Here are a few resources to get you started:

    Main Hadoop landing page (overview, download, data sheets, etc.) - http://www.pentaho.com/hadoop/
    5 part video series explaining how to leverage Hadoop for BI and DI - http://www.pentaho.com/hadoop/resources.php
    Community/Beta Wiki page (videos from various phases of the beta program, documentation attached to beta phase 3 wiki page, etc.) - http://wiki.pentaho.com/display/EAI/...op+Integration

    Note that if you have an identified project you can get enabled with support for a 30 day evaluation period to get you jump started.

    Regards,
    Jake

  3. #3

    Default

    absolutely, there is a Job Entry called the 'Hadoop Transformation Job Executor' that can be used for that purpose. There are also two samples illustrating the use of the Job Entry which can be found in the <PDI install dir>\samples\jobs\hadoop\:

    - hadoop-mr-ktr.kjb
    - weblogs-mr-ktr.kjb

    The first one uses transformations to illustrate implementation of the Hadoop wordcount example using PDI transformations, the second one shows how to do a weblog parse (in the Map phase) followed by a reducer which collapses the data on territory I believe.

    Regards,
    Jake

  4. #4
    Join Date
    Oct 2010
    Posts
    3

    Default

    Thanks Jake,

    I found the following Document as well.

    http://wiki.pentaho.com/download/att...op_pentaho.pdf

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.