Hitachi Vantara Pentaho Community Forums

Search Forums:

Type: Posts; User: adamnyc; Keyword(s):

Page 1 of 4 1 2 3 4

Search Forums: Search took 0.02 seconds.

  1. Got this same error using PDI 7.0 and Redshift...

    Got this same error using PDI 7.0 and Redshift JDBC driver 4.0: [Amazon](500061) ERROR execute prepare/batch statement.

    Didn't resolve it fully. As a workaround, I created a connection using...
  2. Replies
    2
    Views
    1,640

    Take a look at the 'Metadata Injection'...

    Take a look at the 'Metadata Injection' functionality. That should help you with your use case.

    Before using it: check online blogs/tutorials, run through the Pentaho documentation's examples,...
  3. Can't help with debug steps, but confirming I get...

    Can't help with debug steps, but confirming I get same behavior with PDI 7.0.0 when using the repository manager.

    Haven't logged a JIRA ticket from my end -- might already be in there.

    My...
  4. Thread: HTML XLS input

    by adamnyc
    Replies
    2
    Views
    1,124

    Not aware of any pre-built step right off the bat...

    Not aware of any pre-built step right off the bat that will do what you're looking for in an easy fashion.

    There's potential to use multiple PDI steps to address your problem:
    1. convert...
  5. Replies
    1
    Views
    793

    If I understand you correctly, you believe there...

    If I understand you correctly, you believe there is an encoding issue with how PDI reads your inputs (e.g. "Excel_1") and/or how it outputs to MySQL table (e.g. "dim1") -- is that right?

    If yes,...
  6. Replies
    6
    Views
    854

    Have you tried increasing the amount of memory...

    Have you tried increasing the amount of memory used by Spoon in the Windows .bat above?

    Search this forum for many similar threads where people have already given exact details on how to change /...
  7. Replies
    4
    Views
    936

    You can read up on the Kettle feature called...

    You can read up on the Kettle feature called 'Metadata Injection'. That will fit your use case perfectly: one (or multiple) 'main' transformations which can be run against multiple tables with...
  8. Replies
    5
    Views
    2,181

    PDI can help perform checksums on rows (doesn't...

    PDI can help perform checksums on rows (doesn't help your case).

    Other tools/scripts can perform checksums on an entire file. That might help a bit more.

    As an alternative:
    * run a...
  9. Is this only a two-step transformation (1x Table...

    Is this only a two-step transformation (1x Table Input and 1x Group By)?

    I suspect not. What are details of rest of transformation? Without extra detail, probably hard to get help.

    When you...
  10. Replies
    4
    Views
    1,630

    Is the # of retries small-ish (e.g. less than...

    Is the # of retries small-ish (e.g. less than 5-10)? If so, can do a manual chain of 'x' test conditions (using Filter step), where x = number of retries. Each test condition checks a param for...
  11. Replies
    4
    Views
    2,743

    Sorry, I'm still not following exactly,...

    Sorry, I'm still not following exactly, unfortunately. Maybe someone else with more background on Salesforce Upsert step can contribute.

    Parting thoughts:

    * in your SFDC object, is the field...
  12. Replies
    4
    Views
    2,743

    Haven't had that sort of problem. Your...

    Haven't had that sort of problem. Your description is a bit vague... can you be more specific?

    Have you confirmed that your connectivity is working correctly? Can you use, for example,...
  13. Replies
    3
    Views
    1,760

    Never used Pentaho integrated version control, so...

    Never used Pentaho integrated version control, so can't comment on that approach.

    I use GIT for version control of PDI solutions. Haven't tried it on SVN. My feedback:

    Plus:Kettle...
  14. I go overboard with saving connections... yes, I...

    I go overboard with saving connections... yes, I suspect that you can save more than one DB Connection.

    Try opening, in Spoon, one of the Jobs / Transformations which has the connection info for...
  15. Replies
    3
    Views
    639

    I'll add one more thing to look at: In one of...

    I'll add one more thing to look at:

    In one of your 'Group By' steps (you will likely need more than 1), look at the use/functionality of the option for Type = 'Concatenate strings separated by ,'
  16. Replies
    3
    Views
    639

    It's not clear which 2 rows get failed in your...

    It's not clear which 2 rows get failed in your example. Do you mean these 6 rows/records should be rejected:



    Without doing your work for you (there are some more requirements analysis that...
  17. Replies
    5
    Views
    1,731

    Looks like the problem is with how you've...

    Looks like the problem is with how you've configured the Microsoft Excel input step... the error is saying it can't read the file you specified.

    Did you create the two .XLSX Excel files as...
  18. Glad to hear it worked! The Dimension...

    Glad to hear it worked!

    The Dimension Lookup/Update step is amazing awesomesauce, however it's a bit picky to start using it!

    For future reference: definitely always include screenshots of how...
  19. No, not using it incorrectly -- as @marabu...

    No, not using it incorrectly -- as @marabu mentions above, the 'Get Fields' data type sensing (even if you select all rows) is a convenience feature; not meant to be foolproof.

    The feature (Get...
  20. As always: which version of PDI, which OS? Are...

    As always: which version of PDI, which OS?

    Are you using the PDI step named 'Dimension Lookup/Update'? If so, how are you configuring that step (including both the lookup info... front tab... as...
  21. Agreed that Java 8+ required -- always make sure...

    Agreed that Java 8+ required -- always make sure you post the required info (operating system, PDI version, Java version, etc).

    Check the Java configuration you are using in Spoon.bat (Windows).
    ...
  22. In the past I've had good success in Windows...

    In the past I've had good success in Windows environment with this tool from http://www.oaultimate.com/ (not related to the company; just sharing what I've used).

    URL:...
  23. Replies
    4
    Views
    1,407

    Great points -- lots of useful steps got Metadata...

    Great points -- lots of useful steps got Metadata Injection support in 7.0.

    List of steps from Pentaho's 7.0 documentation... see 'Version Introduced' for steps with added/expanded Metadata...
  24. PDI is meant as a data integration tool, not a...

    PDI is meant as a data integration tool, not a reporting tool. I realize it's very easy to to consider PDI to be a reporting tool since functions like the Excel Template output make it so easy.
    ...
  25. Replies
    4
    Views
    1,407

    Look at PDI-specific blogs to read about 7.0,...

    Look at PDI-specific blogs to read about 7.0, such as: http://pedroalves-bi.blogspot.com/2016/10/pentaho-7.0.html

    Many features are for Enterprise Edition, not Community Edition.
  26. Replies
    33
    Views
    14,980

    Hey, ain't that a pickle... I did a workaround...

    Hey, ain't that a pickle...

    I did a workaround you posted in separate thread (http://forums.pentaho.com/showthread.php?206429-Slow-ness-in-PDI-CE-6-1), and I realize in PDI 7.0 that that...
  27. Replies
    7
    Views
    3,610

    Holy cow... I hadn't heard that Karaf workaround...

    Holy cow... I hadn't heard that Karaf workaround before (removing/renaming those XMLs)... just tried it for giggles, and Spoon launched *CRAZY* quick! Wow, wow, wow!

    What are implications of this...
  28. Replies
    33
    Views
    14,980

    In PDI 7.0, try the dropdown in top-right that...

    In PDI 7.0, try the dropdown in top-right that says "Connect" :-)
    17352

    Has a link to Repository Manager, however I'm having difficulty loading that on my current machine.

    Repository settings...
  29. Replies
    3
    Views
    1,913

    Strange behavior. I'm on W7, PDI 7.0, and used...

    Strange behavior. I'm on W7, PDI 7.0, and used mysql-connector-java-5.1.38-bin.jar (slightly earlier than your version) to connect to MySQL 5.7.11 without issue. Configured PDI DB connection as...
  30. Yes, the "Send xyz to results" should work in...

    Yes, the "Send xyz to results" should work in another (sub)-job that has (sub-)transformations that "Get xyz from result".

    Since you're dealing with filenames... are you converting the...
  31. Replies
    6
    Views
    763

    First, consider posting in the BI server forum...

    First, consider posting in the BI server forum (this is the PDI forum).

    Second, which version of Pentaho are you using (5.x, 6.x, etc), and are you using Enterprise or Community Edition?
  32. Replies
    1
    Views
    1,381

    What have you tried / tested already? How is...

    What have you tried / tested already?

    How is your Excel file stored in SharePoint?

    Is it in a single library, with a file name that never changes? If yes, then trying using the standard Excel...
  33. Awesome! Thanks also for adding back to the...

    Awesome! Thanks also for adding back to the community by sharing that very helpful suggestion of editing kettle.properties with a default number format.

    It is crazy-useful for everyone reading...
  34. It is not clear where in your processing this is...

    It is not clear where in your processing this is "not working." Can you explain where you feel there is an issue?

    Even with your dynamic table/column selection method, the PDI formatting is just...
  35. Replies
    5
    Views
    1,635

    See the other post on suggestion for PDI book......

    See the other post on suggestion for PDI book... it will really help understand how to use PDI for something like this.

    A couple things:
    * there should not be two separate inputs going into...
  36. Replies
    5
    Views
    1,635

    When you use 'Get System Info', the object you...

    When you use 'Get System Info', the object you select ("Today HH:MM:SS") gets cast as PDI/Java type 'Date' (use the Preview function and hover over the column created... it will show up as Date. ...
  37. Many steps have different ways to set the...

    Many steps have different ways to set the conversion string / format string for values they (the steps) create, however Table Input step doesn't have this.

    Try adding a 'Select Values' step...
  38. Replies
    3
    Views
    835

    The SQL paradigm of looping through an open...

    The SQL paradigm of looping through an open cursor (as in the stored procedure above) does not have a direct analog in PDI.

    Suggestion to understand row-based stream of PDI processing will help...
  39. Replies
    3
    Views
    835

    Are you familiar with the PDI tools? If not, I...

    Are you familiar with the PDI tools? If not, I would recommend you check out the book 'Pentaho Data Integration Beginner's Guide'. ...
  40. Seems like the main challenge here is copying the...

    Seems like the main challenge here is copying the trees of issues then updating the IDs, yes?

    Others on this forum may know a more fancy-pants programming pattern to describe this. (I'm all...
  41. Seems like the 'Join Rows (Cartesian Product)'...

    Seems like the 'Join Rows (Cartesian Product)' step is the way to go.

    Have you configured your input Steps correctly for the two sheets?

    One way to check: run your Transformation in Preview...
  42. Replies
    5
    Views
    2,944

    Thanks for the extra comments -- that helps...

    Thanks for the extra comments -- that helps better understand what you may be doing.

    I don't have PDI version 5 loaded anymore, however it may be a configuration issue. Screenshots from my PDI...
  43. Replies
    5
    Views
    2,944

    Great that you've joined the community and are...

    Great that you've joined the community and are looking to use PDI!

    To best help answer your questions, it's usually a good idea to:

    1. Describe what your intended output should be (ex: what do...
  44. Replies
    4
    Views
    829

    That line helped understand what you're trying to...

    That line helped understand what you're trying to do... seems like you have user-defined functions at the RDBMS level which you'd like to execute upon an Insert/Update, yes?

    If you wish to keep...
  45. Replies
    3
    Views
    1,063

    From the simplest case, you can execute the...

    From the simplest case, you can execute the Kettle transformation with non-production information and use logging to determine whether transformation succeeded or failed.

    For more complete...
  46. Seems like this is in the wrong forum -- you may...

    Seems like this is in the wrong forum -- you may get more luck / help if you post this in the forum named "BI Platform"
  47. Replies
    5
    Views
    1,998

    Not within transformation (e.g. Table Input...

    Not within transformation (e.g. Table Input step), but you should be able to parameterize the Database Connection used within the transformation (e.g. use PDI parameters for JDBC/ODBC/JNDI connection...
  48. Replies
    3
    Views
    891

    Alternatively, if you only want to call the...

    Alternatively, if you only want to call the existing BCP utility (not replicate similar functions)... then you can create a batch file / powershell script and call it in a PDI 'Job' via Shell command...
  49. I agree with @marabu that playing around with PDI...

    I agree with @marabu that playing around with PDI string format can help eliminate that in most cases.

    I've seen similar behavior (leading blank space character) when converting numeric->string...
  50. Replies
    3
    Views
    891

    Maybe forum folks with more experience on bulk...

    Maybe forum folks with more experience on bulk loading can comment on the specifics. (SSIS BCP = bulk copy)

    PDI has several steps dealing with high-performance bulk copying... look at the steps...
Results 1 to 50 of 156
Page 1 of 4 1 2 3 4
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.