Hitachi Vantara Pentaho Community Forums
Results 1 to 1 of 1

Thread: BigQuery error with pentaho 8.2 using table output step

  1. #1
    Join Date
    Oct 2013
    Posts
    6

    Unhappy BigQuery error with pentaho 8.2 using table output step

    We did a pentaho big query with a simple data row generator for 3 coloum and the same column was added to the target ( big query) . Here we used table output step to write to the target


    We are able to successfully connect and browse the big-query schema and tables on the target using target connections but how ever when we try to run the etl it fails with the below error



    Table output.0 - The Simba driver for a Google Big Query database connection does not support regular DDL statements. Please use the GBQ Bulk Loader step to create your table.



    We also checked the jira for same error but it says its fixed on 8.2 but still no go

    The detailed row level logging is as follows



    2019/02/19 20:11:33 - Spoon - Using legacy execution engine
    2019/02/19 20:11:33 - CI-Test - Transformation is pre-loaded.
    2019/02/19 20:11:33 - CI-Test - nr of steps to run : 7 , nr of hops : 6
    2019/02/19 20:11:33 - Spoon - Transformation opened.
    2019/02/19 20:11:33 - Spoon - Launching transformation [CI-Test]...
    2019/02/19 20:11:33 - Spoon - Started the transformation execution.
    2019/02/19 20:11:33 - CI-Test - Dispatching started for transformation [CI-Test]
    2019/02/19 20:11:33 - CI-Test - Nr of arguments detected:0
    2019/02/19 20:11:33 - CI-Test - This is not a replay transformation
    2019/02/19 20:11:33 - CI-Test - I found 2 different steps to launch.
    2019/02/19 20:11:33 - CI-Test - Allocating rowsets...
    2019/02/19 20:11:33 - CI-Test - Allocating rowsets for step 0 --> Data grid
    2019/02/19 20:11:33 - CI-Test - prevcopies = 1, nextcopies=1
    2019/02/19 20:11:33 - CI-Test - Transformation allocated new rowset [Data grid.0 - Table output 2.0]
    2019/02/19 20:11:33 - CI-Test - Allocated 1 rowsets for step 0 --> Data grid
    2019/02/19 20:11:33 - CI-Test - Allocating rowsets for step 1 --> Table output 2
    2019/02/19 20:11:33 - CI-Test - Allocated 1 rowsets for step 1 --> Table output 2
    2019/02/19 20:11:33 - CI-Test - Allocating Steps & StepData...
    2019/02/19 20:11:33 - CI-Test - Transformation is about to allocate step [Data grid] of type [DataGrid]
    2019/02/19 20:11:33 - CI-Test - Step has nrcopies=1
    2019/02/19 20:11:33 - Data grid.0 - distribution activated
    2019/02/19 20:11:33 - Data grid.0 - Starting allocation of buffers & new threads...
    2019/02/19 20:11:33 - Data grid.0 - Step info: nrinput=0 nroutput=1
    2019/02/19 20:11:33 - Data grid.0 - output rel. is 1:1
    2019/02/19 20:11:33 - Data grid.0 - Found output rowset [Data grid.0 - Table output 2.0]
    2019/02/19 20:11:33 - Data grid.0 - Finished dispatching
    2019/02/19 20:11:33 - CI-Test - Transformation has allocated a new step: [Data grid].0
    2019/02/19 20:11:33 - CI-Test - Transformation is about to allocate step [Table output 2] of type [TableOutput]
    2019/02/19 20:11:33 - CI-Test - Step has nrcopies=1
    2019/02/19 20:11:33 - Table output 2.0 - distribution activated
    2019/02/19 20:11:33 - Table output 2.0 - Starting allocation of buffers & new threads...
    2019/02/19 20:11:33 - Table output 2.0 - Step info: nrinput=1 nroutput=0
    2019/02/19 20:11:33 - Table output 2.0 - Got previous step from [Table output 2] #0 --> Data grid
    2019/02/19 20:11:33 - Table output 2.0 - input rel is 1:1
    2019/02/19 20:11:33 - Table output 2.0 - Found input rowset [Data grid.0 - Table output 2.0]
    2019/02/19 20:11:33 - Table output 2.0 - Finished dispatching
    2019/02/19 20:11:33 - CI-Test - Transformation has allocated a new step: [Table output 2].0
    2019/02/19 20:11:33 - CI-Test - This transformation can be replayed with replay date: 2019/02/19 20:11:33
    2019/02/19 20:11:33 - CI-Test - Initialising 2 steps...
    2019/02/19 20:11:33 - Data grid.0 - Released server socket on port 0
    2019/02/19 20:11:33 - Table output 2.0 - Released server socket on port 0
    2019/02/19 20:11:33 - Table output 2.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : An error occurred intialising this step:
    2019/02/19 20:11:33 - Table output 2.0 - The Simba driver for a Google Big Query database connection does not support regular DDL statements. Please use the GBQ Bulk Loader step to create your table.
    2019/02/19 20:11:33 - Table output 2.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Error initializing step [Table output 2]
    2019/02/19 20:11:33 - CI-Test - Step [Data grid.0] initialized flawlessly.
    2019/02/19 20:11:33 - CI-Test - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Step [Table output 2.0] failed to initialize!
    2019/02/19 20:11:33 - Spoon - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : CI-Test: preparing transformation execution failed
    2019/02/19 20:11:33 - Spoon - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException:
    2019/02/19 20:11:33 - Spoon - We failed to initialize at least one step. Execution can not begin!
    2019/02/19 20:11:33 - Spoon -
    2019/02/19 20:11:33 - Spoon -
    2019/02/19 20:11:33 - Spoon - at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:1272)
    2019/02/19 20:11:33 - Spoon - at org.pentaho.di.ui.spoon.trans.TransGraph$30.run(TransGraph.java:4287)
    2019/02/19 20:11:33 - Spoon - at java.lang.Thread.run(Thread.java:748)
    2019/02/19 20:11:33 - CI-Test - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Errors detected!
    2019/02/19 20:11:33 - CI-Test - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Errors detected!



    Can some body advise us if there is something missing on this ? or Anyone connected successfully to big-query and done a data load with 8.2 ?
    Last edited by greyyfox7; 02-20-2019 at 05:28 AM. Reason: more details and versioning details

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2017 Pentaho Corporation. All Rights Reserved.