Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Creating transformation in 3.7

  1. #1

    Default Creating transformation in 3.7

    I am using Pentaho Data Integrator 4.1
    I have experienced some issues while creating an transformation.
    when i tried to map different datasource ie database,excel,xml with output database,the transformation is successful.

    but when i try to do it together ie extracting the data from 3 different datasources and then mapping to single database,then the transformation fails..

    can i get to know what is the reason for this problem.

    thanks in advance.
    any idea or suggestions are welcome.

  2. #2
    Join Date
    Nov 2008
    Posts
    143

    Default

    Maybe you're joining streams with different metadata (number of rows, data type etc).

    Could you please post your error log?

  3. #3

    Default

    hi..
    thanks for the quick reply.
    below is the scenario on which i am creating the transformation:-
    Input:-
    1 RDBMS datasource having 2 fields ie id(integer),name(varchar).
    1 Excel file having 2 fields ie eid,ename.
    1 XML file having 2 fields ie xid,xname.

    output:-
    1 RDBMS table having 2 fields ie gid(Integrer),gname(varchar).

    when i try to run only with datasource,the transformation is sucessful,but when i try to execute all,then error occurs.
    i have realized that spoon takes the number input as double.
    but the problem which i am not able to understand is that when i try to run independant it runs,but in group it fails.

    so i changed the id of both table input as well as output to double,then the transformation was successfull.

    can you please tell me what is the issue??
    below is the error which i get,when i try to execute the transformation:-
    ===========================================================
    2011/02/07 11:06:30 - Spoon - Transformation opened.
    2011/02/07 11:06:30 - Spoon - Launching transformation [Transformation 1]...
    2011/02/07 11:06:30 - Spoon - Started the transformation execution.
    2011/02/07 11:06:31 - Transformation 1 - Dispatching started for transformation [Transformation 1]
    2011/02/07 11:06:31 - Transformation metadata - Natural sort of steps executed in 0ms (7 time previous steps calculated)
    2011/02/07 11:06:31 - Transformation 1 - This transformation can be replayed with replay date: 2011/02/07 11:06:31
    2011/02/07 11:06:31 - Table output.0 - Connected to database [pentaho4.1] (commit=1000)
    2011/02/07 11:06:31 - Table input.0 - Finished reading query, closing connection.
    2011/02/07 11:06:31 - Table input.0 - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0)
    2011/02/07 11:06:31 - Select values.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
    2011/02/07 11:06:31 - Get data from XML.0 - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0)
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : Because of an error, this step can't continue:
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : org.pentaho.di.core.exception.KettleValueException:
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : gid Integer(9) : There was a data type error: the data type of java.lang.Double object [3.0] does not correspond to value meta [Integer(9)]
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : org.pentaho.di.core.row.ValueMeta.getString(ValueMeta.java:1350)
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : org.pentaho.di.core.row.RowMeta.getString(RowMeta.java:184)
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : org.pentaho.di.core.row.RowMeta.getString(RowMeta.java:605)
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:434)
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:117)
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : org.pentaho.di.trans.step.RunThread.run(RunThread.java:40)
    2011/02/07 11:06:31 - Table output.0 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : java.lang.Thread.run(Thread.java:619)
    2011/02/07 11:06:31 - Select values 3.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
    2011/02/07 11:06:31 - Excel Input.0 - Finished processing (I=1, O=0, R=0, W=0, U=0, E=0)
    2011/02/07 11:06:31 - Table output.0 - Finished processing (I=0, O=1, R=2, W=0, U=0, E=1)
    2011/02/07 11:06:31 - Spoon - The transformation has finished!!
    2011/02/07 11:06:31 - Transformation 1 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : Errors detected!
    2011/02/07 11:06:31 - Transformation 1 - ERROR (version 4.1.0-stable, build 14410 from 2010-11-16 16.43.28 by buildguy) : Errors detected!
    2011/02/07 11:06:31 - Transformation 1 - Transformation 1
    2011/02/07 11:06:31 - Transformation 1 - Transformation 1
    ======================================================================================================================

    thanks in advance..

  4. #4
    Join Date
    Nov 2008
    Posts
    143

    Default

    Kettle is perfect for your scenario.
    Try checking the transformation before you run it, see of no error lines are pointed out.
    Sounds like your inputs have different types and names, so they would'nt be accepted by a single output.
    Either padronize your rows metadata with Select Values step, or define them with the same name/type in their respective input steps.

    Cheers,

    Renato

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.