Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Problem with "Stream lookup" using "CSV input"

  1. #1
    Join Date
    Mar 2009
    Posts
    15

    Default Problem with "Stream lookup" using "CSV input"

    Hi,
    I have created a nice transformation using a DB input and adding a Excel file input via Stream lookup for testing. Now i have to switch to the correct input generated by a differed system (no direct DB access possible). I changed the Excel Input to CSV Input and now my job isn't working any more.

    This is my CSV Input:
    Code:
    Fieldname    Type    Length    Precision    Step origin    Storage    Mask    Decimal    Group    Trim    Comments
    P_Nr    Integer    -    0    CSV input (person)    binary-string        ,    .    none    
    Name    String    13    -    CSV input (person)    binary-string                none    
    Vorname    String    10    -    CSV input (person)    binary-string                none    
    costcenter    String    4    -    CSV input (person)    binary-string        ,    .    none    
    Jahr    String    4    -    CSV input (person)    binary-string        ,    .    none    
    Monat    String    1    -    CSV input (person)    binary-string        ,    .    none    
    PNK_Gruppe    String    12    -    CSV input (person)    binary-string                none    
    full_time_equivalent    Number    -    -    CSV input (person)    binary-string                none    
    costtype    String    -    -    CSV input (person)    binary-string                none
    Why do I have to use "binary-string" isn't there a possibility to chance that, I guess that's the source of my problem.


    my stream lookup (input fields)
    Code:
    Fieldname    Type    Length    Precision    Step origin    Storage    Mask    Decimal    Group    Trim    Comments
    p_id_sva    Integer    9    0    lookup pers_Nr TT    normal    #;-#    ,    .    none    p_id_sva
    mapped_tt_id    Integer    9    0     input (tt_pcc)    normal    #;-#    ,    .    none    mapped_tt_id
    my stream lookup (outout fields)
    Code:
    Fieldname    Type    Length    Precision    Step origin    Storage    Mask    Decimal    Group    Trim    Comments
    PNK_Gruppe    String    12    -    Stream lookup    normal                none
    These is my error log
    Code:
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : Unexpected error : 
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : java.lang.RuntimeException: Error serializing row to byte array
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) :     at org.pentaho.di.core.row.RowMeta.extractData(RowMeta.java:814)
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) :     at org.pentaho.di.trans.steps.streamlookup.StreamLookup.addToCache(StreamLookup.java:337)
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) :     at org.pentaho.di.trans.steps.streamlookup.StreamLookup.readLookupValues(StreamLookup.java:201)
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) :     at org.pentaho.di.trans.steps.streamlookup.StreamLookup.processRow(StreamLookup.java:404)
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) :     at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2889)
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) :     at org.pentaho.di.trans.steps.streamlookup.StreamLookup.run(StreamLookup.java:512)
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : Caused by: java.lang.RuntimeException: PNK_Gruppe String(12)<binary-string> : There was a data type error: the data type of java.lang.String object [B 3] does not correspond to value meta [String(12)<binary-string>]
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) :     at org.pentaho.di.core.row.ValueMeta.writeData(ValueMeta.java:2042)
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) :     at org.pentaho.di.core.row.RowMeta.writeData(RowMeta.java:444)
    2009/08/18 09:55:20 - Stream lookup.0 - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) :     at org.pentaho.di.core.row.RowMeta.extractData(RowMeta.java:807)
    ....
    
    2009/08/18 09:55:21 - org.pentaho.di.ui.core.dialog.PreviewRowsDialog$6@13e2b4a - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : org.pentaho.di.core.exception.KettleValueException: 
    2009/08/18 09:55:21 - org.pentaho.di.ui.core.dialog.PreviewRowsDialog$6@13e2b4a - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : P_Nr Integer : There was a data type error: the data type of [B object [[B@538cc2] does not correspond to value meta [Integer]
    ...
    unfortunately I have absolutely no idea how i could solve that problem - would be great, whether anybody has some suggestions.

  2. #2
    Join Date
    Sep 2008
    Posts
    168

    Default

    Hi,

    you have to disable lazy conversion for your input.

  3. #3
    Join Date
    Mar 2009
    Posts
    15

    Default

    great thanks, it works!!!!!!
    I would have never guessed that!

  4. #4
    Join Date
    Jan 2014
    Posts
    3

    Default

    Thanks dibe0015

    ( I just came across this issue today )

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.