Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: PMR Failing with mssing libraries

  1. #1
    Join Date
    Nov 2008
    Posts
    9

    Default PMR Failing with mssing libraries

    Hi all,

    I'm trying to get Pentaho Map Reduce working in our corporate Cluster (CDH 5.4, with 6.01 Kettle and the approriate shim). The libraries get copied up to HDFS no Problem, and then in my user home I get a .staging Directory with a job_xyz subfolder containg Job.jar, Job.xml, jop.split and Job.splitmetainfo. There are no subdirectories in this Folder (e.g. lib). The application fails with the message :

    Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

    It seems that somehow the required librares are not accessible. Does this sound familar to anyone out there?

    Thanks.

    Russ

  2. #2

    Default

    This will happen if you are using it from a Windows client.

    Open the mapred-site.xml in the shim folder, and add the following lines:

    <property>
    <name>mapreduce.app-submission.cross-platform</name>
    <value>true</value>
    </property>

    Remember, you will have to clear out the /opt/pentaho/mapreduce folder on the cluster so this file can get pushed out when you run the MapReduce job from Spoon

    HTH

    - Naveen

  3. #3
    Join Date
    Nov 2008
    Posts
    9

    Default

    Quote Originally Posted by pdibigdatafan View Post
    This will happen if you are using it from a Windows client.

    Open the mapred-site.xml in the shim folder, and add the following lines:

    <property>
    <name>mapreduce.app-submission.cross-platform</name>
    <value>true</value>
    </property>

    Remember, you will have to clear out the /opt/pentaho/mapreduce folder on the cluster so this file can get pushed out when you run the MapReduce job from Spoon

    HTH

    - Naveen

    Thanks Naveen - I'm currenly fighting with Kerberos, but will check if that helps.

    Russ

  4. #4

    Default

    Start a new thread with any Kerberos issues that you need help with.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.