Hitachi Vantara Pentaho Community Forums
Results 1 to 10 of 10

Thread: merge rows issue 304

  1. #1
    Join Date
    Jan 2008
    Posts
    17

    Default merge rows issue 304

    Hello,

    I migrate a transformation from 241 to 304. It works fine with 241 but with 304 I didn't get the right result.

    Some data 'identical' with 241 are 'new' with 304 wich is wrong.

    How can I get the right result. Best regards - Laurence
    Last edited by sboden; 11-17-2008 at 12:18 PM.

  2. #2
    Join Date
    May 2006
    Posts
    4,882

    Default

    Took the liberty of removing your .ktr's ... DON't post transformations containing full IP, user, and password

    Your transformations are too big to say anything useful on them. I would start again from your 2.4.1 ... load them in 3.04... save them and then do a diff to see what changed. Further more what do you get as "wrong" behaviour or error?

    And you can try attaching your .ktrs after that... while deleting ip/user/password.

    Regards,
    Sven

  3. #3
    Join Date
    Jan 2008
    Posts
    17

    Default

    Thank you Sven for deleting the transformation. (I don't know how to delete ip/user/password).

    I already tried to upload the transformation from 241 after export to an xml file to verify the rules. No success.
    Well the good result should be to fing data with 'identical' and not 'new' as I found with 304.
    I checked on the same database.

    Thanks for you help - Laurence

  4. #4
    Join Date
    May 2006
    Posts
    4,882

    Default

    For the deletion of IP/user/password... just open up the ktr and make the corresponding fields empty e.g.

    For the rest... since we don't have your database, there's little we can really see.... unless you have more indications (errors, wrong behaviour, ...)... and if possible reduce the problem to a transformation as small as possible and still showing the problem.

    Regards,
    Sven

  5. #5
    Join Date
    Jan 2008
    Posts
    17

    Default

    Hello Sven,

    Well, I send you an excel file where you can see the result of the merge for 241 and 304. In red are the mistakes.
    The database is the same : I do a preview.
    Perhaps it can help for solve my problem.
    Bets regards and Thanks for your help. Laurence
    Attached Files Attached Files

  6. #6
    Join Date
    May 2006
    Posts
    4,882

    Default

    I don't see anything at first sight.

    Now for the sanitized version of the .ktr and a sample of input data for the merge sort.

    You can get the input data for the merge sort by copying your transformation... removing every from the merge step to the end and writing both inputs to the merge step to a CSV file e.g.

    Regards,
    Sven

  7. #7
    Join Date
    Jan 2008
    Posts
    17

    Default

    The 'new' is wrong because in the source table the information already exist, it should be 'identical'.

    I will try what you proposed. Best regards
    Laurence

  8. #8
    Join Date
    Jan 2008
    Posts
    17

    Default

    Hello Sven,

    I send you the preview results before the merge in csv files. I hope it will give you an idea of my problem. Best Regards -
    Laurence
    Attached Files Attached Files
    Last edited by Fayette; 11-26-2008 at 05:56 AM.

  9. #9
    Join Date
    May 2006
    Posts
    4,882

    Default

    Which doesn't tell a lot... sorting looks strange (but in both versions).

    So what we actually need is:
    - a transformation and inputs which we can run without using your database (and which shows your problem)... The moment you use a database we can't do a lot of playing anymore with the transformation.

    Regards,
    Sven

  10. #10
    Join Date
    Jan 2008
    Posts
    17

    Default

    Hello Sven,

    I tried to create a transformation with Excel Input or txt Input : impossible. I get several error :
    during the preview :

    org.pentaho.di.core.exception.KettleException:
    We failed to initialize at least one step. Execution can not begin!

    at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:580)
    at org.pentaho.di.ui.spoon.trans.TransLog.debug(TransLog.java:835)
    at org.pentaho.di.ui.spoon.delegates.SpoonTransformationDelegate.executeTransformation(SpoonTransformationDelegate.java:1028)
    at org.pentaho.di.ui.spoon.Spoon.executeTransformation(Spoon.java:6205)
    at org.pentaho.di.ui.spoon.Spoon.executeFile(Spoon.java:6194)
    at org.pentaho.di.ui.spoon.Spoon.previewFile(Spoon.java:6184)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:585)
    at org.pentaho.xul.EventHandler.handleMenuEvent(EventHandler.java:42)
    at org.pentaho.xul.swt.toolbar.Toolbar.handleMenuEvent(Toolbar.java:92)
    at org.pentaho.xul.swt.toolbar.ToolbarButton.widgetSelected(ToolbarButton.java:53)
    at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:866)
    at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:5638)
    at org.pentaho.di.ui.spoon.Spoon.run(Spoon.java:5739)
    at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:371)

    And when I filled in the Excel Input Object I filled the File or Directory but the file is not find and if I save the information and reopen the object the file I specify doesn't appears anymore.

    I will be great in your spoon documentation to present each object with a sample to show how to filled them....

    There too much issues...

    Best regards

    Laurence




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.