Latest version of Kettle / PDI

[MattCasters]

Dear Kettle friends,

The latest version of Kettle can always be downloaded from our community website:

http://community.pentaho.com/projects/data-integration/

On this page you will also find links to documentation, source code and so on.

If you want to try our the enterprise edition of Pentaho Data Integration please go to:

http://www.pentaho.com/download

Have fun with Kettle!

Matt

[rushi.nasre@gmail.com]

What is the Difference Between 5.0 and 4.4 PDI?

[mpp4manu]

Does this address performance issues when saving a transformation from a local Windows workstation to a remote MySQL repository database?

I am having serious performance issues when saving a transformation stored in a remote repository from Spoon to a MySQL PDI database repository (5.0.1 CE stable) over a VPN. Save time for a relatively simple transformation exceeds 5 minutes.

If I run spoon locally on the server that is running the MySQL repository database, then a save takes only a few seconds.

I performed a couple of tests where I added a single word to the name of a step and then saved it. Here are results:

Spoon source: Local Windows 7 (64 bit) workstation
Network Connection: VPN over 18 MBPS connection
Remote MySQL Database Repository Server: MySQL 5.5.17 on Red Hat Enterprise Linux 5 server, which is also running a carte instance
Total time to save: 491 seconds

Spoon source: Local Red Hat Enterprise Linux 5 server (same server running repository database)
Network Connection: VPN over 18 MBPS connection (using TightVNC to Gnome desktop)
Remote MySQL Database Repository Server: MySQL 5.5.17 on Red Hat Enterprise Linux 5 server, which is also running a carte instance
Total time to save: 2 seconds

Based upon the logs, and this may be a misinterpretation as transactions may be unrelated but were all part of the same MySQL session ID, over 3000 statements were executed to perform the save. Nonetheless, the save of the transformation on the Linux Spoon instance (local to the MySQL database) was over 200 times faster.

[dizzy]

What is the Difference Between 5.0 and 4.4 PDI?

I'm also missing "what's new" / "notable improvements" description. All we have on downloads page is link to JIRA, which is not very intuitive - there's no changelog for 5.1.0 and even if it was, JIRA page is not the best way to show new features in an update.

[scripty]

I'm also missing "what's new" / "notable improvements" description. All we have on downloads page is link to JIRA, which is not very intuitive - there's no changelog for 5.1.0 and even if it was, JIRA page is not the best way to show new features in an update.

I agree the JIRA is not ideal for listing new features to an end user. I usually direct our users to this link to the knowledge base for an overview of what's new:

https://support.pentaho.com/forums/2...ness-Analytics

Daniel Bechtel added an article there in December detailing What's new in 5.0. It contains references to PDI but focuses on the full suite, so you have to pick through for what's new in PDI.

Hope that helps.

[chabra]

There is a What's New in DI page at the Pentaho Documentation site. Each change has links to documentation articles that explain them more fully:

http://help.pentaho.com/Documentation/5.1/0T0/040/000

Minor functionality changes are listed here:

http://help.pentaho.com/Documentation/5.1/0T0/040/010

[Cleto May]

Hey guys,

I noticed that the output of a fuzzy match in pentaho data integration 5.1 doesn't works. When you add an additional field from the compared data set, that field comes with data from the others fields.

I don't know if it is the right place to say it, but, just a recommendation.

To reproduce the error execute the attached transformation in both version (5.0 and 5.1) and see the result.

fuzzy_match.ktr

[Mick_data]

Hi Cleto,
it's not the right place :-P
If you think it's a bug and it's reproducible, please create a new issue in Jira:
http://jira.pentaho.com

[oscarmu]

Hello,

On pentaho jira website 5.4.0 is out but I couldn't find it on sourceforge. Why?

http://jira.pentaho.com/browse/PDI/?...hangelog-panel

Thank you.

[asoenksen]

I just upgraded to PDI 5.4 from 5.0. Our Repository is a MS SQL database.
When connected, an error is repeatedly returned while using the Navigation Pane: "!Spoon.ErrorDialog.ErrorFetchingFromRepo.NamedCluster! Unable to get list of element types for namespace 'pentaho'"
When I attempted to Upgrade the Repository, it also errors "This database type is not supported for the use as a database repository." Continuing anyway results in a Java ArrayIndexOutOfBoundsException.

I exported our database repository and imported into a file rep and everything seems to work as expected. However, this is not our desired architecture.
Any help is appreciated.
Alyssa

[gkanks]

Are you sure you're looking at the correct Pentaho project?

I see it there with yesterday's date at: http://sourceforge.net/projects/pent...20Integration/

[nathanhart]

All of the instructions I'm finding is to upgrade from 4.X to 5.0, are there any instructions for upgrading from 5.3 to 5.4? We'd like to avoid having both up simultaneously and then having to migrate if possible. Just a preference.

[nathanhart]

Not sure when the new upgrade utility and migration information was posted, but it worked well. I did have to make a manual change to pentaho-spring-beans.xml under /pentaho-solutions/system, but everything else started right up.

[Mick_data]

Hi.
I have noticed that according to JIRA version PDI 6.0 GA has every issue solved, but it has not been released yet.
Any reason why PDI 6 is not out? Is Pentaho preparing a big campaign launch and waiting for other components such as Reporting to be ready?
Thanks.

[johanhammink]

I think Pentaho wants to release the whole 6.0 stack the same day. The release date is October 14 . See http://www.pentaho.com/product/data-...ho-6-0-release

[gouthamgoud]

I am unable to find download link for Pentaho Data Integration 5.4.0.6. I tried in sourceforge, but its not there (http://sourceforge.net/projects/pent...tegration/5.4/).

[Mick_data]

Hi.
Looking at Jira it seems that a version for PDI 7.04 is ready, but it's not available for download in Sourceforge.
Is there a compiled version available somewhere else?
Or do I need to download the source code and compile it myself? (note that I have no idea how to do that!)
Thanks

[nbarnes]

Hi,

I've encountered a bug which is fixed in 7.1. How can I get a pre-release version other than building source?

[tnewman]

Hi,

You can download PDI CE 7.1 - https://sourceforge.net/projects/pen...20Integration/

HTH

[alexkart]

Hi all, are PDI 6 and 7 versions compatible, can I edit transformations in PDI 7 that were created in PDI 6 and vice versa?

[gutlez]

Hi all, are PDI 6 and 7 versions compatible, can I edit transformations in PDI 7 that were created in PDI 6 and vice versa?

Typically, you can open a transformation in a newer version and edit it.
An older version usually will not be able to open/run a transform from a newer version.

[tnewman]

FYI - PDI CE version 8 available - https://sourceforge.net/projects/pen...Pentaho%208.0/