Hitachi Vantara Pentaho Community Forums

Search Forums:

Type: Posts; User: Mathias.CH; Keyword(s):

Page 1 of 8 1 2 3 4

Search Forums: Search took 0.03 seconds.

  1. Don't know the roadmap for upgrading, but since...

    Don't know the roadmap for upgrading, but since this is open source, a solution could be to re-package the library with another name and then just drop it into lib/ directory. Then use full package...
  2. I think a git integration should be mandatory! ...

    I think a git integration should be mandatory!

    Especially for EE version that says "repository with version control system" which actually means "repository where you can merely just keep history...
  3. Replies
    7
    Views
    1,666

    Should be (.*)\s (\S*) $ No?

    Should be
    (.*)\s (\S*) $

    No?
  4. Just use a calculator with NVL (field1, field2)

    Just use a calculator with NVL (field1, field2)
  5. Replies
    4
    Views
    1,265

    Another way is to do the string -> date...

    Another way is to do the string -> date conversion in PDI, then let your jdbc driver deal with a real java Date:

    Set your variable at job level like you wanted to do.
    In your transformations do:...
  6. Replies
    4
    Views
    1,800

    Seems like a bug! It works on 5.4, dont know for...

    Seems like a bug!
    It works on 5.4, dont know for v7.

    Solution: get filenames --> excel input with accept filenames from previous step
  7. If you have lot of rows and need some...

    If you have lot of rows and need some performance, you should implement parsing in a UDJC with
    some java json library (see answers on...
  8. Replies
    2
    Views
    3,822

    Just create a wrapper .bat file to configure and...

    Just create a wrapper .bat file to configure and launch spoon:

    -- myspoon.bat
    Set local
    set PENTAHO_JAVA_HOME=the path to your java
    Set KETTLE_HOME=my speciale kettle home
    spoon.bat %*

    ...
  9. I think the problem is not the \ at the ends, but...

    I think the problem is not the \ at the ends, but the quotes which are part of your env var OD.
    Try with
    SET "OD=C:\Temp\"

    instead of
    SET OD="C:\Temp\"


    Or use %~OD% to get the value...
  10. If you dont use big data stuffs (hadoop, spark or...

    If you dont use big data stuffs (hadoop, spark or cloud nosql databases), you dont need EE features.
    Before version 7, PDI EE provided a DI server which encompass a repository, a scheduler and a...
  11. Replies
    2
    Views
    1,132

    What did not work?? A BLOB should get in as a...

    What did not work??
    A BLOB should get in as a binary field in pentaho and get out as-is in postgres, no?
  12. Replies
    7
    Views
    1,255

    Show us your database join config please...

    Show us your database join config please...
  13. Hi, don't use arbitrary string values as variable...

    Hi, don't use arbitrary string values as variable in SQL query.
    That's not portable and potentialy a security issue (sql injection) if parameter is set by a user.

    So, put a get variable step to...
  14. Replies
    3
    Views
    1,203

    With as much RAM and CPU maybe you also better...

    With as much RAM and CPU maybe you also better try to paralellize your jobs and each one use less RAM.
    Like build a Carte cluster on the same server, each one with less RAM but execute everything in...
  15. Hi one trick is to cross join with a select from...

    Hi one trick is to cross join with a select from dual to get all params:

    Select ..... from LOAD_TEST t, (select ? as p1, ? as p2 from dual) p
    WHERE t.rowid = to_number (substr (p.p2,9) )

    ...
  16. Hi, The job-entry name is used only to...

    Hi,

    The job-entry name is used only to identify uniquely each job entry in a job meta.
    So you cannot ask ut replaces your runtime variable because it must exists before runtime is set.
    So the...
  17. Replies
    9
    Views
    3,060

    Hi and welcome! In PDI you cannot just "loop"...

    Hi and welcome!

    In PDI you cannot just "loop" because here we have a conceptual problem:
    - each stream in PDI is row stream: every rows have same layout/fields, but you have many rows.
    - in JSON...
  18. Replies
    2
    Views
    1,578

    If you already have a java backend implementing...

    If you already have a java backend implementing Drools logic, you should be able to use it directly in PDI.
    Just add your java libraries in pdi classpath, then call your java code from a javascript...
  19. Personnaly i will do it both/triple ways,...

    Personnaly i will do it both/triple ways, benchmark, then keep the best.
    Then i'll had learn some stuff.
  20. Poll: Disclaimer: I have no experience on cloud...

    Disclaimer: I have no experience on cloud installation.
    But:
    A "cloud" environnement is no magic: it is a logical structure / api over a set of multiple nodes which are
    physical server.

    So...
  21. Try with forward slash instead of backslash in...

    Try with forward slash instead of backslash in your path string.
  22. Replies
    2
    Views
    1,135

    Havig experienced a migration from PDI 3.2 to PDI...

    Havig experienced a migration from PDI 3.2 to PDI 5.4 (yeah kind of a big leap :P )
    I think you shouls be concerned of EVERYTHING!
    Set up a new (test) environnement with version 7.0
    Then export...
  23. Replies
    4
    Views
    1,058

    I think licenses are checked at startup, so try...

    I think licenses are checked at startup, so try (or not ;P) to restart your server
  24. You mean you have rows with 40 different layout...

    You mean you have rows with 40 different layout (number and type of fields)?
    So you had split your stream into 40 stream, than parse eah layout such that the result stream has the same layout for...
  25. What's your expression to check the string is...

    What's your expression to check the string is null?
  26. Replies
    1
    Views
    604

    Since you know last date you've got, you can scan...

    Since you know last date you've got, you can scan only directories that concerns the month starting from last date.
    So do get filenames in two step:
    1. Get only directories names, filter where...
  27. Replies
    4
    Views
    2,883

    You use Carte if: 1. You dont have a...

    You use Carte if:
    1. You dont have a DI/BI/Pentaho server
    2. You build a Data integration cluster: so you have a Master node with Carte/DI/BI/Pentaho server installed.
    Then you have slave servers...
  28. Well, we need more details but my opinion is the...

    Well, we need more details but my opinion is the best strategy would be:
    1. Stage your LDAP data into some raw tables
    2. Build your new model starting from the raw stagged tables.

    So you...
  29. Replies
    4
    Views
    1,159

    You can use the job/trans executor where you...

    You can use the job/trans executor where you specify number of rows in a batch.
    Like prepare a stream with all your xml filenames, send it to job executor by batch of 100 rows.
    In the sub job, put...
  30. Replies
    4
    Views
    1,384

    Well, seems it is waiting forever for a new...

    Well, seems it is waiting forever for a new connection from the pool...
    So how did you set your connections pool?

    Moreover, try once with no connection pooling, just to be sure the problem comes...
  31. We had same problem with DI server 5.4.0.1,...

    We had same problem with DI server 5.4.0.1, everything works fine for one or two days
    than everythings gets really slow, even a generate row with a dummy step.
    I suspect some ressource not being...
  32. Hi I want to know what you mean for data...

    Hi I want to know what you mean for data virtualisation?
    Data cannot be virtualize, it must exists somewhere.
    If you mean virtualizing a particular schema representation of data, maybe from...
  33. Replies
    13
    Views
    3,871

    Try writing the path with (single) slashs, not...

    Try writing the path with (single) slashs, not backslash.
  34. Replies
    13
    Views
    3,871

    How many files do you have in your folder? How...

    How many files do you have in your folder?
    How did you write your filepath exactly?
  35. Replies
    4
    Views
    1,815

    Maybe your best bet is to implement your post...

    Maybe your best bet is to implement your post call in a javascript step:
    Use a java rest client library, Jersey for example, to do the call on each row
    and implement retries.
    This maybe the...
  36. Replies
    3
    Views
    1,990

    I would say that the integrated "version control"...

    I would say that the integrated "version control" should not be called like that:
    It is just keeping all versions of all individual files.
    There's no way to package a precise version of a set of...
  37. In this particular example, you could just do a...

    In this particular example, you could just do a string replace using regular expressions
  38. So before your group by you had one row per value?

    So before your group by you had one row per value?
  39. You can use the job/trans executor inside a...

    You can use the job/trans executor inside a transformation with multiple copies defined by a parameter
    of the transformation.
    Do a trans with a paramater nbrOfJob.
    Then table input (get list of...
  40. Replies
    6
    Views
    4,460

    Finally a note on the difference between...

    Finally a note on the difference between executing jobs with DI server/Carte or with
    Kitchen batch:
    With DI server/Carte, you have only one JVM. It is always running, and jobs shares the ressouces...
  41. Replies
    6
    Views
    4,460

    Here is the different components of the DI...

    Here is the different components of the DI solution:
    1. Spoon is the DI Designer. So consider it as a graphical IDE to develop your ETL process. It is not meant to execute
    the ETL in production,...
  42. What do you mean by "flow contains one thousand...

    What do you mean by "flow contains one thousand step"?
    Do you mean you have
    A. one transformation with 1000 steps,
    or
    B. 1000 transformations?

    If A.:
    That's waaayyyyy to much! Each step run...
  43. Awaiting your example transformation, but here is...

    Awaiting your example transformation, but here is some stuff to check that can result
    in different keys in merge step:
    - if you order your stream inside the DB and have string keys, there might be...
  44. Hi, ok that's a hard one. Maybe you can try...

    Hi, ok that's a hard one.
    Maybe you can try that, dont know if it works:
    Do like you did, but for the template 2 sheet, write
    [Path to template2 excel file]![name of template 2 sheet]
    (Without...
  45. Hi, when using a template sheet, you need to...

    Hi, when using a template sheet, you need to provide the name of the sheet to use in the file your are writing to,
    not a filename.
    So how to do it:
    Create only one template file, with two sheets:...
  46. Replies
    6
    Views
    1,763

    I rather think of it of a ratio between input...

    I rather think of it of a ratio between input speed and output speed, without thinking on the values.
    If it is more like 1/1 it means the steps read stuff and write stuff at same regular speed, so...
  47. Replies
    8
    Views
    1,878

    Yep I made the hypothesis that OP said it uses a...

    Yep I made the hypothesis that OP said it uses a getVariable step and set the type as Pdi Boolean.
    But yes if you do a getVariable in javascript, you only get String.
  48. Replies
    8
    Views
    1,878

    I will add some tips about that (just for fun):...

    I will add some tips about that (just for fun):
    If(myField == myOtherField) does not work.
    Because then js interpret it as a comparison between Objects: this will be false, since the fields
    are...
  49. Replies
    8
    Views
    1,878

    Yes that is part of the answer: Javascript makes...

    Yes that is part of the answer:
    Javascript makes a lot of implicit type conversions when the data you use is not of the "good" type.
    It is supposed to make life easier, but generally makes only...
  50. Replies
    3
    Views
    1,531

    I didnt see any error message in the logs...only...

    I didnt see any error message in the logs...only INFO.
    What happens? Are you sure the job dont run?
Results 1 to 50 of 361
Page 1 of 8 1 2 3 4
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.