Hitachi Vantara Pentaho Community Forums

Search Forums:

Type: Posts; User: MattCasters; Keyword(s):

Page 1 of 100 1 2 3 4

Search Forums: Search took 0.10 seconds.

  1. Calculate unique values in parallel for Neo4j Node creation

    Hi Kettle and Neo4j fans!
    So maybe that title is a little bit over the top but it sums up what this transformation does:...
  2. Replies
    0
    Views
    637

    Catching up with Kettle REMIX

    Dear Kettle and Neo4j friends,
    Since I joined the Neo4j team in April I haven’t given you any updates despite the fact that a lot of activity has been taking place in both the Neo4j and Kettle...
  3. Replies
    0
    Views
    1,555

    Farewell Pentaho

    Dear Kettle friends,
    12 years ago I joined a wonderful team of people at Pentaho who thought they could make a real change in the world of business analytics. At that point I recently open sourced...
  4. Replies
    0
    Views
    5,742

    Pentaho Community Meetup 2016 recap

    Dear friends,
    I just came back from PCM16, the 9th annual edition of our European Pentaho Community Meetup. We had close to 200 subscriptions for this event of which about 150 showed up making this...
  5. Dynamic and Scalable : Pentaho 6.1 has arrived!

    Hello Kettle and Pentaho fans!
    Yes indeed we’ve got another present for you in the form of a new Pentaho release: version 6.1
    This predictable steady flow of releases has in my opinion pushed the...
  6. Replies
    3
    Views
    1,080

    Hi Bart, Perhaps you can try the GIS plugin...

    Hi Bart,

    Perhaps you can try the GIS plugin from the marketplace but with the shape file you're out of luck I think. I wrote that step too long ago (13 years!!) to even remember how to implement...
  7. Replies
    0
    Views
    1,531

    Matt’s Mad Labs Hangout

    I’m starting a new quick and easy way for Pentaho labs to connect to the community: a regular hangout.
    The first hangout will take place on February 16th, 7pm CET, 1pm Eastern, 10am Pacific.
    ...
  8. Java VM doesn't clean up or garbage collect...

    Java VM doesn't clean up or garbage collect memory unless it absolutely has to. Also make sure your transformation is gone from Carte.
    Finally, we've had database JDBC drivers with memory leaks so...
  9. The answer nevertheless is "Yes", steps do close...

    The answer nevertheless is "Yes", steps do close connections when they're finished.
    The notable exception is when you are running the transformation with transaction support (obviously).
  10. Replies
    2
    Views
    950

    The issue is OS specific, in this case Linux/GTK...

    The issue is OS specific, in this case Linux/GTK specific in the sense that it tries to be too clever. Windows can't do multi-line tables so in general we should see this as an advantage. Spoon/PDI...
  11. Replies
    5
    Views
    2,421

    The log records are stored where you tell them to...

    The log records are stored where you tell them to be stored. In that database and in that table you will find them.
  12. Replies
    1
    Views
    804

    So create a web-app and then use the Kettle API...

    So create a web-app and then use the Kettle API to integrate the data?

    http://wiki.pentaho.com/display/EAI/Executing+a+PDI+transformation
  13. Replies
    4
    Views
    822

    Here are a few transformations which generate...

    Here are a few transformations which generate CSV, MongoDB and weblog records.

    https://github.com/mattcasters/data-generator
  14. Replies
    6
    Views
    3,090

    Your expectations of me are too high...

    Your expectations of me are too high unfortunately.
    Call Pentaho support of Google around for the error first. You'll notice the error is not Kettle specific.
  15. Kettle CE has an APL which means Apache Public...

    Kettle CE has an APL which means Apache Public License version 2.0.

    http://www.apache.org/licenses/LICENSE-2.0

    There are a few limitations to the license but to be honest I am not a lawyer....
  16. Replies
    5
    Views
    2,421

    http://help.pentaho.com/Documentation/5.2/0L0/0Y0/...

    http://help.pentaho.com/Documentation/5.2/0L0/0Y0/0E0/020
  17. Replies
    1
    Views
    889

    A couple of "filter rows" steps with the...

    A couple of "filter rows" steps with the conditions and "Select values" to rename/map the fields?
  18. PDI never truncates strings unless you explicitly...

    PDI never truncates strings unless you explicitly ask it to do so with or example a "String cut" step or "Text file output".
  19. Did you enable boolean support for the database...

    Did you enable boolean support for the database connection?
  20. If it's just a one to one copy then Sqoop would...

    If it's just a one to one copy then Sqoop would do just fine. We have a job entry for Sqoop if you care to try it.
    If you're doing more logic then you can create a Map/Reduce job to drive the GP...
  21. Replies
    2
    Views
    1,033

    Of-course. Not using Map/Reduce would drag way...

    Of-course. Not using Map/Reduce would drag way too much data across the network for anything to be practical.
    So use Hive or a Map/Reduce job (the same really) to aggregate or report on the files.
  22. Replies
    1
    Views
    747

    Oracle really didn't support it in the past...

    Oracle really didn't support it in the past either. They say they don't see any use cases anymore where ODBC usage can not be replaced by a faster JDBC connection. What's your case?

    The...
  23. Replies
    3
    Views
    3,037

    No need to loop over result rows now that we have...

    No need to loop over result rows now that we have the transformation and job executor steps available.
  24. Replies
    5
    Views
    2,421

    Transformations and jobs can indeed log to a...

    Transformations and jobs can indeed log to a database table.
  25. Replies
    6
    Views
    3,090

    Strange thing. Check the options tab, is there...

    Strange thing. Check the options tab, is there an integratedSecurity option specified?
    The Help button on that tab should point you to the list of valid JDBC options for the driver.
  26. Come on people, there are not that many things in...

    Come on people, there are not that many things in Kettle which use memory. Either you're collecting result rows or you're caching stuff (explicit option in a step).
    The logging options are listed...
  27. The error means you're mixing rows with different...

    The error means you're mixing rows with different layout.
  28. What do you mean by "everything crashes"?

    What do you mean by "everything crashes"?
  29. This is old advice, I wouldn't follow it myself. ...

    This is old advice, I wouldn't follow it myself. The "Transformation Executor" and "Job Executor" steps make it very easy to loop over a set of values and to drive parameter values for the looping...
  30. Replies
    6
    Views
    6,863

    I also put a "Compare Fields" step in the...

    I also put a "Compare Fields" step in the marketplace which compares one or more fields.
  31. Replies
    5
    Views
    2,447

    Hang on. If you get a data conversion error on...

    Hang on. If you get a data conversion error on insert/update it might be that you're inserting Strings into a timestamp field or something silly like that.
    Try to avoid the implicit conversion by...
  32. Replies
    2
    Views
    9,420

    Sticky: Best Practices #PCM14

    Best practices information regarding PDI.

    Enjoy,
    Matt
  33. Replies
    5
    Views
    3,472

    Setting the copies parameter is not required...

    Setting the copies parameter is not required of-course, you can hard-code it. But for larger deployments I would call it Best Practice.
  34. Replies
    5
    Views
    3,472

    Duplicates? You mean you specified the number of...

    Duplicates? You mean you specified the number of copies of the step? And you mean you used a parameter like ${JOB_PARALLEL_COPIES} so you can tweak the parallelism without changing the...
  35. Could be a initialization order bug that crept...

    Could be a initialization order bug that crept in. Perhaps the kettle.properties vars are set as system variables after the logging backend starts.
    Please do file a bug in JIRA about your experience.
  36. The native DLLs are shipped inside swt.jar. ...

    The native DLLs are shipped inside swt.jar. However, the Java environment can't load native libs like that, they need to be placed somewhere it can access it.
    So it's using a .swt folder in the...
  37. Replies
    5
    Views
    2,447

    Well, the date format is incorrect and so the...

    Well, the date format is incorrect and so the error is pertinent (/ instead of - used).
    I can't imagine it not throwing an error in 5.0 though.
  38. Replies
    5
    Views
    2,447

    Strange, I'm pretty sure it's always been the...

    Strange, I'm pretty sure it's always been the .SSS format.
    But... I have to note that you can set the default format to your liking in the kettle.properties file editor in Spoon.
  39. Replies
    5
    Views
    3,472

    Multiple ways: - with a Job Executor Step,...

    Multiple ways:
    - with a Job Executor Step, multiple copies, pass different parameter values for the various executions
    - with parallel execution in a job.
    - queues, carte slave servers, load...
  40. If I had to guess I would say that the libs...

    If I had to guess I would say that the libs inside the swt.jar library are not being unpacked due to a strange (incorrect?) configuration issue on your Windows machine.
    Perhaps you're running off a...
  41. Replies
    3
    Views
    1,156

    Kettle API: SlaveServerStatus status =...

    Kettle API:


    SlaveServerStatus status = slaveServer.getStatus();

    // Pass to slave server and execute a transformation
    TransMeta transMeta = new TransMeta("my_trans.ktr");...
  42. Yes it does.

    Yes it does.
  43. Replies
    0
    Views
    4,471

    Pentaho Kettle 解决方案

    您好球迷!
    I just received a copy of the Chinese translation of Pentaho Kettle Solutions.
    Right off the bat when we made it open source over 8 years ago, Kettle became very popular in China. Among the...
  44. Look at the annotated SOAP example in the...

    Look at the annotated SOAP example in the samples/transformations folder.
    The idea is to throw XML over to the webservice, construct it using JavaScript and parse it that way as well.
    That way you...
  45. It might be a very old version you're using. In...

    It might be a very old version you're using. In that case, use a Join Rows step to add the static value to the data stream.
    However, any version from the last 4-5 years shouldn't have a performance...
  46. Always file a bug report please. Performance...

    Always file a bug report please. Performance regressions are top priority bugs. Thanks in advance.
  47. It doesn't convert to a string, a UUID is a...

    It doesn't convert to a string, a UUID is a string.
  48. There are some tools out there to do HTML to XML...

    There are some tools out there to do HTML to XML conversion.
    Parsing HTML with an XML parser on the other hand is not a good idea. (since it's not XML).
  49. PDI has a StAX step as well, you might find it...

    PDI has a StAX step as well, you might find it easy to work with.
  50. Replies
    3
    Views
    1,799

    So assuming you have ID, fullname (use a sequence...

    So assuming you have ID, fullname (use a sequence if you don't have an id) you can use the "Split field to rows" step. Use a "Group By" (include all rows option!) step to add the word number and the...
Results 1 to 50 of 5000
Page 1 of 100 1 2 3 4
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.