Hitachi Vantara Pentaho Community Forums

Search Forums:

Type: Posts; User: MattCasters; Keyword(s):

Page 1 of 100 1 2 3 4

Search Forums: Search took 0.10 seconds.

  1. Replies
    3
    Views
    1,193

    Hi Bart, Perhaps you can try the GIS plugin...

    Hi Bart,

    Perhaps you can try the GIS plugin from the marketplace but with the shape file you're out of luck I think. I wrote that step too long ago (13 years!!) to even remember how to implement...
  2. Java VM doesn't clean up or garbage collect...

    Java VM doesn't clean up or garbage collect memory unless it absolutely has to. Also make sure your transformation is gone from Carte.
    Finally, we've had database JDBC drivers with memory leaks so...
  3. The answer nevertheless is "Yes", steps do close...

    The answer nevertheless is "Yes", steps do close connections when they're finished.
    The notable exception is when you are running the transformation with transaction support (obviously).
  4. Replies
    2
    Views
    1,001

    The issue is OS specific, in this case Linux/GTK...

    The issue is OS specific, in this case Linux/GTK specific in the sense that it tries to be too clever. Windows can't do multi-line tables so in general we should see this as an advantage. Spoon/PDI...
  5. Replies
    5
    Views
    2,567

    The log records are stored where you tell them to...

    The log records are stored where you tell them to be stored. In that database and in that table you will find them.
  6. Replies
    1
    Views
    866

    So create a web-app and then use the Kettle API...

    So create a web-app and then use the Kettle API to integrate the data?

    http://wiki.pentaho.com/display/EAI/Executing+a+PDI+transformation
  7. Replies
    4
    Views
    883

    Here are a few transformations which generate...

    Here are a few transformations which generate CSV, MongoDB and weblog records.

    https://github.com/mattcasters/data-generator
  8. Replies
    6
    Views
    3,299

    Your expectations of me are too high...

    Your expectations of me are too high unfortunately.
    Call Pentaho support of Google around for the error first. You'll notice the error is not Kettle specific.
  9. Kettle CE has an APL which means Apache Public...

    Kettle CE has an APL which means Apache Public License version 2.0.

    http://www.apache.org/licenses/LICENSE-2.0

    There are a few limitations to the license but to be honest I am not a lawyer....
  10. Replies
    5
    Views
    2,567

    http://help.pentaho.com/Documentation/5.2/0L0/0Y0/...

    http://help.pentaho.com/Documentation/5.2/0L0/0Y0/0E0/020
  11. Replies
    1
    Views
    951

    A couple of "filter rows" steps with the...

    A couple of "filter rows" steps with the conditions and "Select values" to rename/map the fields?
  12. PDI never truncates strings unless you explicitly...

    PDI never truncates strings unless you explicitly ask it to do so with or example a "String cut" step or "Text file output".
  13. Did you enable boolean support for the database...

    Did you enable boolean support for the database connection?
  14. If it's just a one to one copy then Sqoop would...

    If it's just a one to one copy then Sqoop would do just fine. We have a job entry for Sqoop if you care to try it.
    If you're doing more logic then you can create a Map/Reduce job to drive the GP...
  15. Replies
    2
    Views
    1,080

    Of-course. Not using Map/Reduce would drag way...

    Of-course. Not using Map/Reduce would drag way too much data across the network for anything to be practical.
    So use Hive or a Map/Reduce job (the same really) to aggregate or report on the files.
  16. Replies
    1
    Views
    790

    Oracle really didn't support it in the past...

    Oracle really didn't support it in the past either. They say they don't see any use cases anymore where ODBC usage can not be replaced by a faster JDBC connection. What's your case?

    The...
  17. Replies
    3
    Views
    3,442

    No need to loop over result rows now that we have...

    No need to loop over result rows now that we have the transformation and job executor steps available.
  18. Replies
    5
    Views
    2,567

    Transformations and jobs can indeed log to a...

    Transformations and jobs can indeed log to a database table.
  19. Replies
    6
    Views
    3,299

    Strange thing. Check the options tab, is there...

    Strange thing. Check the options tab, is there an integratedSecurity option specified?
    The Help button on that tab should point you to the list of valid JDBC options for the driver.
  20. Come on people, there are not that many things in...

    Come on people, there are not that many things in Kettle which use memory. Either you're collecting result rows or you're caching stuff (explicit option in a step).
    The logging options are listed...
  21. The error means you're mixing rows with different...

    The error means you're mixing rows with different layout.
  22. Replies
    3
    Views
    1,029

    What do you mean by "everything crashes"?

    What do you mean by "everything crashes"?
  23. This is old advice, I wouldn't follow it myself. ...

    This is old advice, I wouldn't follow it myself. The "Transformation Executor" and "Job Executor" steps make it very easy to loop over a set of values and to drive parameter values for the looping...
  24. Replies
    6
    Views
    7,463

    I also put a "Compare Fields" step in the...

    I also put a "Compare Fields" step in the marketplace which compares one or more fields.
  25. Replies
    5
    Views
    2,578

    Hang on. If you get a data conversion error on...

    Hang on. If you get a data conversion error on insert/update it might be that you're inserting Strings into a timestamp field or something silly like that.
    Try to avoid the implicit conversion by...
  26. Replies
    2
    Views
    9,823

    Sticky: Best Practices #PCM14

    Best practices information regarding PDI.

    Enjoy,
    Matt
  27. Replies
    5
    Views
    3,812

    Setting the copies parameter is not required...

    Setting the copies parameter is not required of-course, you can hard-code it. But for larger deployments I would call it Best Practice.
  28. Replies
    5
    Views
    3,812

    Duplicates? You mean you specified the number of...

    Duplicates? You mean you specified the number of copies of the step? And you mean you used a parameter like ${JOB_PARALLEL_COPIES} so you can tweak the parallelism without changing the...
  29. Could be a initialization order bug that crept...

    Could be a initialization order bug that crept in. Perhaps the kettle.properties vars are set as system variables after the logging backend starts.
    Please do file a bug in JIRA about your experience.
  30. The native DLLs are shipped inside swt.jar. ...

    The native DLLs are shipped inside swt.jar. However, the Java environment can't load native libs like that, they need to be placed somewhere it can access it.
    So it's using a .swt folder in the...
  31. Replies
    5
    Views
    2,578

    Well, the date format is incorrect and so the...

    Well, the date format is incorrect and so the error is pertinent (/ instead of - used).
    I can't imagine it not throwing an error in 5.0 though.
  32. Replies
    5
    Views
    2,578

    Strange, I'm pretty sure it's always been the...

    Strange, I'm pretty sure it's always been the .SSS format.
    But... I have to note that you can set the default format to your liking in the kettle.properties file editor in Spoon.
  33. Replies
    5
    Views
    3,812

    Multiple ways: - with a Job Executor Step,...

    Multiple ways:
    - with a Job Executor Step, multiple copies, pass different parameter values for the various executions
    - with parallel execution in a job.
    - queues, carte slave servers, load...
  34. If I had to guess I would say that the libs...

    If I had to guess I would say that the libs inside the swt.jar library are not being unpacked due to a strange (incorrect?) configuration issue on your Windows machine.
    Perhaps you're running off a...
  35. Replies
    3
    Views
    1,232

    Kettle API: SlaveServerStatus status =...

    Kettle API:


    SlaveServerStatus status = slaveServer.getStatus();

    // Pass to slave server and execute a transformation
    TransMeta transMeta = new TransMeta("my_trans.ktr");...
  36. Yes it does.

    Yes it does.
  37. Look at the annotated SOAP example in the...

    Look at the annotated SOAP example in the samples/transformations folder.
    The idea is to throw XML over to the webservice, construct it using JavaScript and parse it that way as well.
    That way you...
  38. It might be a very old version you're using. In...

    It might be a very old version you're using. In that case, use a Join Rows step to add the static value to the data stream.
    However, any version from the last 4-5 years shouldn't have a performance...
  39. Always file a bug report please. Performance...

    Always file a bug report please. Performance regressions are top priority bugs. Thanks in advance.
  40. It doesn't convert to a string, a UUID is a...

    It doesn't convert to a string, a UUID is a string.
  41. There are some tools out there to do HTML to XML...

    There are some tools out there to do HTML to XML conversion.
    Parsing HTML with an XML parser on the other hand is not a good idea. (since it's not XML).
  42. PDI has a StAX step as well, you might find it...

    PDI has a StAX step as well, you might find it easy to work with.
  43. Replies
    3
    Views
    1,945

    So assuming you have ID, fullname (use a sequence...

    So assuming you have ID, fullname (use a sequence if you don't have an id) you can use the "Split field to rows" step. Use a "Group By" (include all rows option!) step to add the word number and the...
  44. Replies
    21
    Views
    32,171

    Sticky: Latest version of Kettle / PDI

    Dear Kettle friends,

    The latest version of Kettle can always be downloaded from our community website:

    http://community.pentaho.com/projects/data-integration/

    On this page you will also find...
  45. We keep track of the list over here:...

    We keep track of the list over here: http://wiki.pentaho.com/display/EAI/ETL+Metadata+Injection
    In the past we tried to implement all requested injection support for steps in JIRA before a major...
  46. It is absolutely the case. All PDI EE features...

    It is absolutely the case. All PDI EE features are implemented as plugins on CE, including the job level database transactions.
    To be precise, these plugins were written to facilitate job level...
  47. Updated the doc anyway

    Updated the doc anyway
  48. In version 5 or higher you can go to the plugin...

    In version 5 or higher you can go to the plugin information browser under the Help menu.
    The ID of the Carte servlet plugin is the servlet service address like this: /kettle/<id> or...
  49. It's usually less of a problem if you run...

    It's usually less of a problem if you run everything in one database transaction. It's an old post so I have to ask: did you turn on the "Make the trasnsformation database transactional?" in the...
  50. Belgian partner know.bi actually has written a...

    Belgian partner know.bi actually has written a BIRT Output step you might be able to use. Code: https://github.com/knowbi/BIRTOutput
Results 1 to 50 of 5000
Page 1 of 100 1 2 3 4
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.