Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Pentaho PDI between two Hadoop distribution???????

  1. #1
    Join Date
    Dec 2013
    Posts
    10

    Question Pentaho PDI between two Hadoop distribution???????

    Hi all,

    Is it possible to use Pentaho Data Integration (Kettle) between two different Hadoop distributions? Say, your source is some version of Apache or Cloudera and your target is some version of MapR or HartonWorks or something else (am just giving random example). So you are doing your regular Big Data ETLs to extract, polish, cleanse, and load big data from source Hadoop system to target Hadoop system.

    Am interested in knowing, how to configure our Pentaho Kettle (single instance) with these two source and destination Hadoops for Plugin.Properties file, shims etc and run the KTR and Jobs. If available, can you please share the How-To documents?


    ----
    Thanks and Regards,
    Rajeev, Bengaluru, India.

  2. #2
    Join Date
    Dec 2013
    Posts
    10

    Default

    How come not a single reply? Nobody came with this kind of scenario yet?

  3. #3
    Join Date
    Apr 2008
    Posts
    1,771

    Default

    Maybe I'm wrong, but can't you create 2 different jobs?
    -- Mick --

  4. #4
    Join Date
    Dec 2013
    Posts
    10

    Default

    I think you didn't got my question! I need to understand how to configure my Pentaho PDI to connect two different Hadoop system at a time? Can you please share with me documents, if any, to guide me the same?

    At present, I think, Pentaho can be configured to connect only one Hadoop system at a time and multiple connection is not possible, and don't know I may be wrong!

    ----
    Thanks and Regards,
    Rajeev, Bengaluru, India.

  5. #5
    Join Date
    Apr 2008
    Posts
    1,771

    Default

    Hi.
    Sorry but I haven't tried it so I can't help.
    Maybe you should move this post to the BIG DATA forum?
    -- Mick --

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.