Hitachi Vantara Pentaho Community Forums
Results 1 to 9 of 9

Thread: How can I know who's guilty?

  1. #1

    Default How can I know who's guilty?

    Hi!

    I have one transformation who make a text file, and it works almost find because sometimes this appens :

    Code:
     2| 300050| 305369| 1| 302644|F Laurent|TiersPersonnePhysique||FLAURENT||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
     2| 2| 300267| 301861| 1| 302125|D Edgard|TiersPersonnePhysique||DEDGARD||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
     2| 300193| 302012| 1| 302386|L Pierre|TiersPersonnePhysique||LPIERRE||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
    or this

    Code:
    2| 300889| 304442| 1| 305096|F Laurent|TiersPersonnePhysique||FLAURENT||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
    300050| 305369| 1| 302644|F Laurent|TiersPersonnePhysique||FLAURENT||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
    2| 300050| 305369| 1| 302644|F Laurent|TiersPersonnePhysique||FLAURENT||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
    And if I ran again my transformation à few minutes latter, my file is perfect.

    So who's guilty?
    pdi-ce-4.4.0-stable
    jdk1.7.0_09
    Intel Core I3-2330M@2.2Ghz - 8Go ram
    Windows 7 FEP SP1

  2. #2
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    Well, I don't believe in Text File Output to be the main culprit.
    If you can't reproduce the error at will, you will have a hard time to find out.
    I recall a case where someone used multiple TFO steps writing to the same file in the same transformation leading to strange results.
    Do you mind to attach your transformation?

    BTW: Usually you don't want whitespace in a delimited text file. You can avoid it easily by enabling the fast dump option.
    So long, and thanks for all the fish.

  3. #3

    Default

    you're a wizard marabu, don't you know that?

    This morning my transformation includes a few sub transformations who all write in the same text file.
    Since then, every subtransformation do it to it's own file, and that help's me to find the subtransformation who causes me this bug, here it is TiersDetteDepenseExport.ktr

    I guess that maybe is the "TDD_Fusion" step who's guilty, what do you think?
    Last edited by jcachico; 02-14-2014 at 07:05 AM.
    pdi-ce-4.4.0-stable
    jdk1.7.0_09
    Intel Core I3-2330M@2.2Ghz - 8Go ram
    Windows 7 FEP SP1

  4. #4
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    Frankly, I think you should redesign your transformation.
    Try to avoid the blocking of steps, use a job instead.

    BTW: Did you know the Flow Designer (Spoon) sports a magnetic grid? Makes it easy to avoid staircase hops, if you don't like them.


    PS: When it comes to wizardry, I just try to be like Rincewind:

    reputed for being able to solve minor problems by turning them into major disasters
    Not always successful, though.
    So long, and thanks for all the fish.

  5. #5

    Default

    Quote Originally Posted by marabu View Post
    Frankly, I think you should redesign your transformation.
    yeah, I know, but the thing is that rebuild all that mess again is not à option for my boss, even when I tell him that is not stable

    Quote Originally Posted by marabu View Post
    Try to avoid the blocking of steps, use a job instead.
    I don't understand this, my goal was to wait step1 to go to step 2, are you telling me that using a job can do the same?
    What about the "context", must I pass it to the job for example?

    Quote Originally Posted by marabu View Post
    BTW: Did you know the Flow Designer (Spoon) sports a magnetic grid? Makes it easy to avoid staircase hops, if you don't like them.
    Sorry, what's youre point here, my transformation looks ungly?


    Quote Originally Posted by marabu View Post
    Not always successful, though.
    Don't be that shy, for time to time you're right you know
    pdi-ce-4.4.0-stable
    jdk1.7.0_09
    Intel Core I3-2330M@2.2Ghz - 8Go ram
    Windows 7 FEP SP1

  6. #6
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    Quote Originally Posted by jcachico View Post
    my goal was to wait step1 to go to step 2, are you telling me that using a job can do the same?
    Better yet, it's designed to do just that.

    Quote Originally Posted by jcachico View Post
    What about the "context", must I pass it to the job for example?
    Job entries communicate via result stream or files.

    Quote Originally Posted by jcachico View Post
    my transformation looks ungly?
    Ugly is too hard a word, but something caught my eye ...
    Name:  staircase.png
Views: 36
Size:  7.4 KB
    So long, and thanks for all the fish.

  7. #7

    Default

    Analysing my files, one question came to my mind.

    Is it possible, that sometimes, the buffer (who's content will be in my file) keep the datas from a precedent row or they is a sort of garbage collector that empty this buffer for each row?
    pdi-ce-4.4.0-stable
    jdk1.7.0_09
    Intel Core I3-2330M@2.2Ghz - 8Go ram
    Windows 7 FEP SP1

  8. #8
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    I found the thread where someone suffered from buffer overwrite: Follow me
    So long, and thanks for all the fish.

  9. #9

    Default

    Quote Originally Posted by marabu View Post
    I found the thread where someone suffered from buffer overwrite: Follow me
    Look what we have here, sounds familiar...

    So I know what I will do this week end...
    pdi-ce-4.4.0-stable
    jdk1.7.0_09
    Intel Core I3-2330M@2.2Ghz - 8Go ram
    Windows 7 FEP SP1

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.