Hitachi Vantara Pentaho Community Forums

Search Forums:

Type: Posts; User: matthewtckr; Keyword(s):

Page 1 of 2 1 2

Search Forums: Search took 0.02 seconds.

  1. Yikes, I shouldn't have asked :P The error...

    Yikes, I shouldn't have asked :P

    The error message did sound familiar, and I was able to come across PDI-16969, which looks like it may fix the issue you're experiencing. There were some other...
  2. I don't see much details in the other threads...

    I don't see much details in the other threads that were referenced in the first post. Any chance you can re-create the issue with sample data or a sample KTR that can be shared?

    What version of...
  3. In the SQL Server JDBC connection, you need to...

    In the SQL Server JDBC connection, you need to add a parameter called 'sendStringParametersAsUnicode' with a value of 'false'.

    The JDBC driver defaults to sending any String values as nvarchar to...
  4. Replies
    1
    Views
    142

    I needed to update the plugin for my own purposes...

    I needed to update the plugin for my own purposes just last week, and I've released an updated copy of the plugin on GitHub. The updated version should hopefully be in the marketplace soon.

    Let...
  5. You might try changing the "Number of rows in...

    You might try changing the "Number of rows in rowsets" to a lower value in that specific transformation file, as PDI is likely buffering the XML content between steps, which may take up a lot of the...
  6. The Community Edition has been under the Apache...

    The Community Edition has been under the Apache License, Version 2.0 for a long time (previously LGPL). I'd imagine that they'd very-publicly announce changes to the CE edition licensing if they were...
  7. Replies
    2
    Views
    295

    One other thing to consider is how long it takes...

    One other thing to consider is how long it takes to load data using the MySQL client on the same system where PDI is running.

    If you run a 'LOAD DATA' query with a CSV file, does it take just as...
  8. Replies
    2
    Views
    672

    Hi zhaonameloc, If you can post a sample KTR...

    Hi zhaonameloc,

    If you can post a sample KTR that reproduces the issue, I'll be happy to take a look at it.
  9. There's either an issue with product training or...

    There's either an issue with product training or genuinely missing features if you're regularly being asked about EE. It wouldn't hurt to setup a call with the sales team just to get answers on what...
  10. The PDI EE version provides additional features,...

    The PDI EE version provides additional features, mainly through additional steps and job entries (or features like Kerberos support in Hadoop).

    The main features that running a job on a Pentaho...
  11. Replies
    1
    Views
    386

    That's a lot of settings to change. What error...

    That's a lot of settings to change. What error are you actually seeing? Are there any errors in the MySQL server log around the same time as your transformation is running?
  12. Replies
    2
    Views
    537

    When the Mail Validator step runs, you're having...

    When the Mail Validator step runs, you're having it do a check against the mail server for that domain. In this case, it appears that the mail server is refusing to allow your connection.

    Using...
  13. Replies
    1
    Views
    604

    You might try using the latest 8.1 release as a...

    You might try using the latest 8.1 release as a quick test, as I believe there were significant changes made in the Salesforce steps in 7.1, and there were a couple of bugs that cropped up which were...
  14. It appears that there's an improvement request to...

    It appears that there's an improvement request to update the step to support ElasticSearch 5.x or 6.x, in PDI-16656.

    If you're an Enterprise Customer, you may want to reach out to Pentaho Support...
  15. Replies
    6
    Views
    559

    The streaming mode works equally well with any...

    The streaming mode works equally well with any size file, and may be the only option for larger files.
  16. Replies
    9
    Views
    8,804

    This is a 7-year-old forum thread, please create...

    This is a 7-year-old forum thread, please create a new one.

    The Salesforce steps have changed significantly between 7.1 and the earlier version that was discussed in this thread 7 years ago.
    ...
  17. Replies
    2
    Views
    376

    That's a pretty old version too. Pentaho...

    That's a pretty old version too. Pentaho typically just supports the last two major releases (e.g. 8.x and 7.x), so I wouldn't be surprised if they ask a few questions and try to encourage you to...
  18. Replies
    6
    Views
    559

    Old "XLS" format files used a binary storage...

    Old "XLS" format files used a binary storage format. New "XLSX" format files are a series of XML files, compressed into a ZIP file format.

    Because the newer formats are XML based, the Apache POI...
  19. I wish I had a reference link to provide here,...

    I wish I had a reference link to provide here, but I came across a similar issue a couple years ago, and traced it back to an incompatibility between certain MySQL Server and Connector/J versions. If...
  20. Which version of the MySQL JDBC connector are you...

    Which version of the MySQL JDBC connector are you using in PDI?
  21. Glad to hear it's working for you. Salesforce...

    Glad to hear it's working for you.

    Salesforce has an End-of-Life policy for the API endpoints, and it wouldn't be unreasonable for 24.0 and earlier to be shutdown at some point.

    Their web page...
  22. Looks like it was just updated today in the...

    Looks like it was just updated today in the master branch, so it should hopefully be in the next minor/major release.
  23. Please also include the PDI version that you're...

    Please also include the PDI version that you're using along with any errors/logs.
  24. There's an improvement request to have this step...

    There's an improvement request to have this step updated to the latest Janino version: https://jira.pentaho.com/browse/PDI-16772

    I'd love very much just to have an enhanced for loop in the UDJC...
  25. PDI has a step for Google Analytics, which uses...

    PDI has a step for Google Analytics, which uses the Google Analytics Java API.

    I'd recommend taking a look at how that step creates it's connection with OAuth authentication, you might be able to...
  26. I'm guessing you ran this with Debug logging on,...

    I'm guessing you ran this with Debug logging on, hence all the additional log messages about Server URL and Session IDs. It looks like you may have multiple Salesforce Input steps in this...
  27. When I used Hive on a daily basis, the ability to...

    When I used Hive on a daily basis, the ability to insert individual rows into tables was an experimental feature, and it was awfully slow (due to the file-per-inserted-row requirement). Maybe it's...
  28. If you're using the builtin scheduler for the EE...

    If you're using the builtin scheduler for the EE edition, you may need to add a bit of logic into your job.

    I've seen instances where someone wanted the job to run daily, but the data may not be...
  29. Replies
    2
    Views
    945

    Which version of PDI are you using?

    Which version of PDI are you using?
  30. I can say that it's in the PDI 8.0 Enterprise...

    I can say that it's in the PDI 8.0 Enterprise Edition client, not sure about whether it's in the Community Edition.

    I'd recommend looking for "data-integration/plugins/pdi-hana-plugin", which is...
  31. It looks like you'd need to parse the data out of...

    It looks like you'd need to parse the data out of the XML content using Get Data from XML, and then use the Row Denormalizer step in order to get 1 row per item, with fields for each attribute (SKU,...
  32. Replies
    3
    Views
    678

    Hi Eych, I'm the Matt (droid) you're looking...

    Hi Eych,

    I'm the Matt (droid) you're looking for. I wrote that comment a couple years ago, so my memory may be a bit fuzzy, but I was supporting Hadoop and PDI on a daily basis back then, so I...
  33. Off-hand, I'd recommend just doing a "String Cut"...

    Off-hand, I'd recommend just doing a "String Cut" to only keep the first 32k characters.

    Alternatively, you can split the field every 32k characters using a Regular Expression. Note that you'll...
  34. Replies
    1
    Views
    2,931

    The Pentaho software comes in two forms,...

    The Pentaho software comes in two forms, Community Edition, and Enterprise Edition.

    The Community Edition is free, licensed under the Apache Software License, meaning that you're generally ok to...
  35. Hi oring, If the input in your logic is only...

    Hi oring,

    If the input in your logic is only based upon values in the same row, it's not clear why you need to buffer all input rows before doing processing on any of the rows.

    Also, what...
  36. Replies
    2
    Views
    745

    Hi Cat-Cat, You can continue to use the 37.0...

    Hi Cat-Cat,

    You can continue to use the 37.0 API version in PDI, even though Salesforce has provided newer API versions as well. Many PDI users are still using the 21.0 API version successfully....
  37. Hi NivinJacob, I'd recommend taking a look the...

    Hi NivinJacob,

    I'd recommend taking a look the Pentaho's PDI SDK Samples, specifically, the runJobFromRepository method in this sample.

    Hope that helps!
  38. If you have multiple transformations that should...

    If you have multiple transformations that should run in parallel, you might put those into a sub-job (e.g. a "Hubs" sub-job with all of the "Hubs"-related KTRs) and have those KTRs run in parallel. ...
  39. Replies
    15
    Views
    1,141

    In most cases where I've seen a company embed...

    In most cases where I've seen a company embed Kettle libraries into a Java application, they tend to use the Java application as a scheduler / orchestrator for an existing legacy enterprise...
  40. I'd recommend skipping over the 5.0 branch if...

    I'd recommend skipping over the 5.0 branch if you're using JNDI-based database connections, due to a bug in that release.

    I can't speak for much before 4.4, but I don't recall much in recent...
  41. When it comes to Support, typically they may just...

    When it comes to Support, typically they may just require you to export your PDI job to the filesystem, and then execute it there, so that they can rule out the Database Repository being the source...
  42. Off-hand, it sounds like Salesforce can't verify...

    Off-hand, it sounds like Salesforce can't verify the SSL certificate that you're using. It could be caused for a few different reasons.

    1. You are using a self-signed certificate.

    This can...
  43. Replies
    2
    Views
    525

    No, the Sort Rows step does not create a...

    No, the Sort Rows step does not create a 1,000,000 row buffer at the start of the transformation, it uses only very little memory to initialize the step.

    Once the step has reached the maximum...
  44. If you're only running one job at a time, that's...

    If you're only running one job at a time, that's correct, additional CPU cores will have no impact on the performance of the job.

    It's hard to give good guidance on how transformations perform on...
  45. Hi Prad90, PDI jobs are typically run within a...

    Hi Prad90,

    PDI jobs are typically run within a single thread, so any job entries will use that same thread. Because of this, an individual job will not see any benefit from having multiple cores....
  46. The Heartbeat message is a part of the monitoring...

    The Heartbeat message is a part of the monitoring system added into PDI around 6.0 or so. The system uses "Extension Points" of various types throughout the code to flag information for the...
  47. Replies
    1
    Views
    407

    It looks like you may be running into this bug:...

    It looks like you may be running into this bug: http://jira.pentaho.com/browse/PDI-16393

    If you're an EE customer, there is already a patch release with a fix for that bug, otherwise it should be...
  48. Message appears to come from here...

    Message appears to come from here when PDI tries to insert a String value into a database prepared statement. I've assumed that it would simply fail if the String value is larger than the database...
  49. Replies
    2
    Views
    566

    I'm lost on why anyone would need/want to encrypt...

    I'm lost on why anyone would need/want to encrypt their jobs or transformations on-disk.

    Are you running these PDI jobs or transformations on your own servers? If so, implement Full Disk...
  50. I had a similar issue in parsing a large XML...

    I had a similar issue in parsing a large XML document from a vendor, in that the other XML step couldn't load the document in memory without crashing.

    Here's an example transformation:...
Results 1 to 50 of 77
Page 1 of 2 1 2
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.