Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Error Updating Batch Data truncation Help

  1. #1
    Join Date
    Nov 2013
    Posts
    14

    Default Error Updating Batch Data truncation Help

    I need some help

    I am very new to this data integration tool, but i believe i understand the basics of it already
    I have created my self an extract called “ExtractOpps”

    The first step is a extract from Salesforce , data extracted from Sf, goes straight into my sql table
    It gets up to 57000, rows and then it falls over and i don’t have any idea why. I am trying to study the error code, but it has me stumped

    i have attached three images

    Do you have any ideas ?

    Kind regards
    D
    Attached Images Attached Images    

  2. #2
    Join Date
    Apr 2008
    Posts
    1,771

    Default

    The images are not readable, therefore it's impossible to help you.
    Can you copy/paste the error lines?

    But you can change the LOG from Basic to Detailed and see if the error message helps you to find the issue.
    -- Mick --

  3. #3
    Join Date
    Nov 2013
    Posts
    14

    Default

    HI Mick_Dat

    This is the details i get from the execution results tab > Logging


    2013/11/21 15:52:21 - Spoon - Transformation opened.
    2013/11/21 15:52:21 - Spoon - Launching transformation [ExtractOpps]...
    2013/11/21 15:52:21 - Spoon - Started the transformation execution.
    2013/11/21 15:52:21 - ExtractOpps - Dispatching started for transformation [ExtractOpps]
    2013/11/21 15:52:21 - Transformation metadata - Natural sort of steps executed in 0 ms (3 time previous steps calculated)
    2013/11/21 15:52:22 - Stg_SF_Opportunties.0 - Connected to database [FDMS] (commit=1000)
    2013/11/21 16:00:10 - Stg_SF_Opportunties.0 - linenr 50000
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Because of an error, this step can't continue:
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : org.pentaho.di.core.exception.KettleException:
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Error batch inserting rows into table [Stg_SF_Opportunities].
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Errors encountered (first 10):
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Data truncation
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : String or binary data would be truncated.
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) :
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) :
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Error updating batch
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Data truncation
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) :
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) :
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:404)
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:128)
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : at org.pentaho.di.trans.step.RunThread.run(RunThread.java:50)
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : at java.lang.Thread.run(Unknown Source)
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Caused by: org.pentaho.di.core.exception.KettleDatabaseBatchException:
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Error updating batch
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Data truncation
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) :
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:320)
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : ... 3 more
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Caused by: java.sql.BatchUpdateException: Data truncation
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : at net.sourceforge.jtds.jdbc.JtdsStatement.executeBatch(JtdsStatement.java:947)
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:315)
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : ... 3 more
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - Finished processing (I=0, O=57999, R=58000, W=57000, U=0, E=1)
    2013/11/21 16:01:36 - ExtractOpps - ExtractOpps
    2013/11/21 16:01:36 - ExtractOpps - ExtractOpps
    2013/11/21 16:02:03 - Salesforce Input.0 - Finished processing (I=0, O=0, R=0, W=58000, U=0, E=0)
    2013/11/21 16:02:03 - Spoon - The transformation has finished!!
    2013/11/21 16:02:03 - ExtractOpps - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Errors detected!
    2013/11/21 16:02:03 - ExtractOpps - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Errors detected!

  4. #4
    Join Date
    Apr 2008
    Posts
    1,771

    Default

    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Error batch inserting rows into table [Stg_SF_Opportunities].
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Errors encountered (first 10):
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : Data truncation
    2013/11/21 16:01:36 - Stg_SF_Opportunties.0 - ERROR (version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy) : String or binary data would be truncated.
    As you can read, the error states: data truncation.
    In short, some of your source fields from Salesforce are too long for your table in MySQL.
    Either you truncate the data or you modify your MySQL table to allow for longer strings.
    -- Mick --

  5. #5
    Join Date
    Nov 2013
    Posts
    14

    Default

    Mick_Data
    You absolute beauty, I didnt think it was a size issue of the column within the sql table . i made a few changes and it seems to be working okay J

    next job is get this automated J Whoohoo

    Thank you for your time and assistance

    KR
    D

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.