Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: How to efffectively use stream lookup step

  1. #1

    Default How to efffectively use stream lookup step

    Hi All!!!
    I am reading a file
    Name~Age~Gender~DepartmentId
    fsdf~33~M~324321
    ....
    And so on....


    I have another tilt seperated file which has
    DepartmentId~DepartmentName~NumberOf Employees
    .
    .
    .

    I want to generate a new file which should have the DepartmentName corresponding to the DepartmentID along with the other details in the first tilt seperated file



    I tried doing It be Stream lookup step but that wasn't of any help as it was throwing the following errors:
    2016/04/20 13:58:28 - Stream lookup 2.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Unexpected error
    2016/04/20 13:58:28 - Stream lookup 2.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : java.lang.RuntimeException: Error serializing row to byte array
    2016/04/20 13:58:28 - Stream lookup 2.0 - at org.pentaho.di.core.row.RowMeta.extractData(RowMeta.java:921)
    2016/04/20 13:58:28 - Stream lookup 2.0 - at org.pentaho.di.trans.steps.streamlookup.StreamLookup.addToCache(StreamLookup.java:350)
    2016/04/20 13:58:28 - Stream lookup 2.0 - at org.pentaho.di.trans.steps.streamlookup.StreamLookup.readLookupValues(StreamLookup.java:214)
    2016/04/20 13:58:28 - Stream lookup 2.0 - at org.pentaho.di.trans.steps.streamlookup.StreamLookup.processRow(StreamLookup.java:416)
    2016/04/20 13:58:28 - Stream lookup 2.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:60)
    2016/04/20 13:58:28 - Stream lookup 2.0 - at java.lang.Thread.run(Thread.java:745)
    2016/04/20 13:58:28 - Stream lookup 2.0 - Caused by: java.lang.RuntimeException: subTypeValue String<binary-string> : There was a data type error: the data type of java.lang.String object [Copper ores] does not correspond to value meta [String<binary-string>]
    2016/04/20 13:58:28 - Stream lookup 2.0 - at org.pentaho.di.core.row.value.ValueMetaBase.writeData(ValueMetaBase.java:2326)
    2016/04/20 13:58:28 - Stream lookup 2.0 - at org.pentaho.di.core.row.RowMeta.writeData(RowMeta.java:532)
    2016/04/20 13:58:28 - Stream lookup 2.0 - at org.pentaho.di.core.row.RowMeta.extractData(RowMeta.java:914)
    2016/04/20 13:58:28 - Stream lookup 2.0 - ... 5 more



    (Please note both the tables have different no of columns)

    Thnx
    Shreyas

  2. #2
    Join Date
    May 2014
    Posts
    358

    Default

    I don't know what you're trying to do with the stream lookup step, but the error looks like you need to uncheck "lazy conversion" in one of the file inputs.

  3. #3

    Default

    Thnx a ton mate!!!
    It worked...

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.