Hitachi Vantara Pentaho Community Forums

Search Forums:

Type: Posts; User: Jasper; Keyword(s):

Page 1 of 2 1 2

Search Forums: Search took 0.02 seconds.

  1. Well, this...

    Well, this http://jira.pentaho.com/browse/PDI-8906 provides some usefull information about it.

    It stated that the browse function does not work (yet) with HA config in hdfs-site.xml but the base...
  2. Pentaho BigData plugin CDH5, Namenode HA aware or not ?

    Hi,

    I am connecting without problems to Hadoop for file exchanges as long as we provide static FQDN's to the node which is the current ACTIVE node in a Hadoop setup with 1 ACTIVE NN and the other...
  3. Replies
    1
    Views
    2,736

    Problem connecting PDI4.4 to Hive / Hadoop

    Hi,

    I noticed that I am not the only one that ran into trouble while truying to connect to a Hive instance via JDBC in PDI 4.4.
    I have tried multiple setups but just can't get it to work.

    I am...
  4. Replies
    3
    Views
    4,261

    Hi Kenneth, The thing is when you use the...

    Hi Kenneth,

    The thing is when you use the simple version of the job executor the pointers to your hadoop cluster have to be in the jar itself. You have to do some settings for the conf object in...
  5. Replies
    1
    Views
    27,445

    Hi Firantika, Have you set up the Hive table...

    Hi Firantika,

    Have you set up the Hive table upfront? Hive tables definitions can not be generated automatically. You first need to create the hive table on the Hadoop cluster.

    Example:
    From...
  6. Replies
    1
    Views
    1,665

    Hi, Its there now, on the FTP site. 4.2.0 is...

    Hi,

    Its there now, on the FTP site. 4.2.0 is also GA now.

    So never mind
  7. Replies
    1
    Views
    1,665

    PHD 4.2 necessary for PDI EE server 4.2.0 RC1

    Hi,

    I noticed that there is no PHD (Pentaho for Hadoop) 4.2.0 package among the downloads. Is this seperate package still necessary to interact with Hadoop?

    Can I revert to the last available...
  8. Replies
    7
    Views
    2,594

    Hi Jiann, You say: "The transformation I...

    Hi Jiann,

    You say:

    "The transformation I have running is simple and straight forward.

    1x table input
    6x Combination lookup
    1x fact table"
  9. Replies
    0
    Views
    1,723

    double looping in job

    Hi,

    Today I built a sub-sub job which loops within a subjob that loops within the main job. It seems to work but the handover of parameters from the subjob to the looping sub-subJob seems off...
  10. Replies
    8
    Views
    3,677

    To my knowledge you can't connect to Hadoop and...

    To my knowledge you can't connect to Hadoop and Hive with the CE of PDI. Not sure about the CE's of the other modules, but it would suprise me if it would be any different there..
  11. Thank you Gutlez! That will do just fine.

    Thank you Gutlez!

    That will do just fine.
  12. Hi Darrell, I looked into that but the Row...

    Hi Darrell,

    I looked into that but the Row Flattener divides multiple row belonging to a certain group into multiple columns. Moreover you have to know the number of result columns upfront, so it...
  13. Transpose multiple column row values to one (using Javascript?)

    Hi,

    I would like to transpose a list of around 200 subsequent row values in one column into 1 row/field value. I am generating a dynamic SGL statement.

    As far as I know there is no standard...
  14. Think I just found it: ...

    Think I just found it:

    /usr/lib/pentaho/server/data-integration-server/pentaho-solutions/system/jackrabbit/repository/version/.. It seems to be a VHDL file ??

    Seems you won't find any ktr /...
  15. Where is the Enterprise Repository on the file system?

    Hi,

    Just out of interest; Where is the Enterprise Repository (CMS) on the file system of the PDI server?

    I searched the folders tree of /usr/lib/pentaho but can't find anything.
  16. Hi Matt, I will do that...

    Hi Matt,

    I will do that...
  17. Hi all, I have the same problem in 4.1.2.1 GA....

    Hi all,

    I have the same problem in 4.1.2.1 GA.

    When I export and import a full Enterprise Repository with jobs that reference transactions/subjobs by reference (as opposed to reference by ...
  18. Replies
    2
    Views
    2,017

    Hi Karate405, I was just wondering; Did you...

    Hi Karate405,

    I was just wondering;

    Did you use the simple or the advanced version of the Hadoop Job Executor ?
  19. Replies
    2
    Views
    4,065

    Hadoop Job Executor still not working

    Jordan,

    I have done some further testing on this but it is just not working.

    Here is a snippet of the main class of my WordCountJas.jar.
    ...
  20. assign hex code of character to Variable or Parameter

    Hi,

    I have a problem with the standard field seperator used in most of my source files. The seperator is the 'thorn' or ' þ '. The advantage of using the 'thorn' is that it is not/rarely seen in...
  21. Replies
    1
    Views
    1,478

    Don't upgrade to 4.1.1.GA when it is only for...

    Don't upgrade to 4.1.1.GA when it is only for Hadoop. There is nothing in it for Hadoop.

    4.1.2 GA has a lot of extra stuff to offer when it comes to integrating with Hadoop....
  22. Yes, thats the point. The class shown is directly...

    Yes, thats the point. The class shown is directly available from the main class (same jar) but in the configuration shown it raises an error which I will drop you later.

    I have tried multiple...
  23. Hadoop job executor can not take custom output format

    Hi,

    I have a complete jar which runs perfect from the command line. It creates multiple textoutput files, one for every distinct key value.

    However I get some troubles when I try to run it from...
  24. Replies
    2
    Views
    4,065

    Hadoop Job Executor job step

    Hi,

    I have a few questions about the Hadoop Job Executor job step.

    1. First of all I wonder where to put the details (jobtracker address and port / HDFS address and port) when executing a...
  25. Delete / remove first row (header) of a CSV file

    Hi,

    Does anyone have a suggestion which tools/steps to use to easily remove the header row in a datafile of 65.000.000 rows?

    I already have a linux shell script in place that uses the powerfull...
  26. Replies
    3
    Views
    2,807

    Does this solution involve using the distributed...

    Does this solution involve using the distributed cache option in Hadoop?

    There should be a way to leverage the disitributed cache functionality from the PDI Hadoop steps...
  27. Replies
    1
    Views
    1,521

    Trivial, please remove thread PHD can be...

    Trivial, please remove thread

    PHD can be downloaded from FTP site now.
  28. Replies
    1
    Views
    1,478

    PDI 4.1.1 GA considerations

    I noticed the new GA version today.

    What has changed in 4.1.1 in relation to fixes and workarounds mentioned in earlier posts ?
  29. Replies
    1
    Views
    1,521

    Where is the PHD for Hadoop?

    Hi,

    I wonder were the PHD-ee-4.1.0.zip has gone. I noticed that it is no longer there in the standard pdi ee server download.

    Any idea?
  30. Replies
    6
    Views
    3,457

    Hi, It looks like when you use the CLI "hadoop...

    Hi,

    It looks like when you use the CLI "hadoop jar" command directly on the hadoop node both the jackon jars are automatically on the classpath. When the job is submitted by PDI however it is...
  31. Replies
    12
    Views
    7,321

    Actually I didn't read your post quite right. I...

    Actually I didn't read your post quite right. I did replace $HADOOP_HOME/lib/hadoop-core-0.20.0.jar by the +737.jar on all the Hadoop nodes (couldn't hurt because they remain after the CDH2 to CHD3b3...
  32. More info needed

    Amici,

    Maybe you could attach your job and transformations ?
  33. Replies
    6
    Views
    3,457

    mapred job: org/codehaus/jackson/map/JsonMappingException

    Executing a mapred job raises the following error :


    ---------------------------------------------------------------------------------------------------
    2011/01/19 00:26:23 -...
  34. Replies
    6
    Views
    3,457

    Pentaho PHD 4.1.0 GA and Cloudera's CDH3b3

    This is from an earlier post in the thread "Linking up PDI to Hadoop";



    Since I upgraded to CDH3b3 I can only establish connections between the client and Hadoop-0.20.2+737 as far as HDFS (file...
  35. Replies
    12
    Views
    7,321

    Now, my Pentaho to Hadoop CDH3b3 integration is...

    Now, my Pentaho to Hadoop CDH3b3 integration is down after upgrading from CDH2. Hadoop is up again, and so is Hive but the connectivity between PDI and Hadoop is down.

    So if I understand this...
  36. Replies
    3
    Views
    2,807

    Older and wiser now. It is possible to do a...

    Older and wiser now.

    It is possible to do a join with a second input stream in the mapper in addition to the injector like in the ktr file attached. The problem is that this mapper turned out to...
  37. Quite right, it turns out that this issue occurs...

    Quite right, it turns out that this issue occurs when you use uppercase for the hadoop network addresses (hdfs & mapred) on the cluster tab of the hadoop trans job executor. So don't use uppercase...
  38. Immediately followed by the next problem. See...

    Immediately followed by the next problem.

    See http://forums.pentaho.com/showthread.php?80056-Hadoop-Transformation-Job-Executor-Can-not-get-the-relative-path&p=249958#post249958
  39. Hadoop Transformation Job Executor: Can not get the relative path

    Hi,

    Almost at the end of my Hadoop Transformation Job Executor, I suddenly get this error:

    ...
  40. Hi Jordan, You just made my day! Doing 2a. on...

    Hi Jordan,
    You just made my day!

    Doing 2a. on all my nodes gave me a more precise error message at first. I had not renamed my key/value pairs to the required names outKey and outValue in the...
  41. Hi, Could it be that the Hadoop Pentaho Job...

    Hi,

    Could it be that the Hadoop Pentaho Job Executor can not take ktr files that are not from a repository ?
  42. Replies
    12
    Views
    7,321

    Hi Amici, I advise you to use something like...

    Hi Amici,

    I advise you to use something like netstat or wireshark to see what is really going on when your PDI client is reaching out to Hadoop...
  43. Well that installation is outdated now. Now you...

    Well that installation is outdated now. Now you can just unzip the PHD to the Hadoop home install directory. The PHD adds some new files to the $HADOOP_HOME/lib directory, unzipping that care of...
  44. Replies
    1
    Views
    1,224

    I'm afraid so. The icons of the Hadoop...

    I'm afraid so.

    The icons of the Hadoop components don't look as normal in that case. You can use an evaluation key but you have to specially apply for one on Linux.
  45. Hi, It doesn't matter if your client runs on...

    Hi,
    It doesn't matter if your client runs on Windows. It should normally communicate to the Pentaho Distribution for Hadoop (PHD) on the Linux side. I have the same set up and it works.

    Did you...
  46. Could be that the "Base class does not have a...

    Could be that the "Base class does not have a trans" error is raised when there is something wrong with the mapper sub.ktr which is translated for execution in Hadoop.

    Can somebody confirm or is...
  47. Replies
    3
    Views
    2,807

    Push down data integration workload to MR job

    Hi,

    I wonder if it would be possible to connect and join a second input in a mapper transformation which is translated to a executable Hadoop MR jar.

    Between the Injector and the Dummy (Output)...
  48. Hadoop Transformation Job Executor: Base class does not have a trans

    Hi,

    When I run the out-of-the-box "Hadoop Trans Job Executor - weblogs.kjb" sample job I now get this error when it arrives at the Hadoop Transformation Job Executor;
    ...
  49. Replies
    24
    Views
    10,779

    Finally

    Hi,

    Well finally I got everything to work and I have to say the Pentaho part wasn't the problem from the beginning. The problem was the (network)connectivity between my VMware image and the local...
  50. Replies
    5
    Views
    2,374

    I got it to work another way! I changed the line...

    I got it to work another way! I changed the line from spoon.sh

    MOZILLA_FIVE_HOME=$(find /usr/lib -maxdepth 1 -name xulrunner-[0-9]* | head -1)

    into

    MOZILLA_FIVE_HOME=$(find /usr/lib...
Results 1 to 50 of 77
Page 1 of 2 1 2
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.