Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Table Input preview fails

  1. #1
    Join Date
    Sep 2011
    Posts
    1

    Default Table Input preview fails

    I have a Native JDBC MS SQL Server connection set up (SQL Server 2000) for a table input transformation. The Preview function fails 19 out of 20 times. The log that appears shows no errors:
    Code:
    2011/09/22 10:28:24 - Spoon - Logging goes to file:///var/folders/WI/WIMeCRnXGPesGlzgt+f0ck+++TM/-Tmp-/spoon_465c8159-e540-11e0-a32a-f1974676f0e6.log
    2011/09/22 10:28:24 - DBCache - Loading database cache from file: [/Users/phanf/.kettle/db.cache]
    2011/09/22 10:28:24 - DBCache - We read 0 cached rows from the database cache!
    2011/09/22 10:28:27 - class org.pentaho.agilebi.platform.JettyServer - WebServer.Log.CreateListener localhost:10000
    2011/09/22 10:28:27 - Version checker - OK
    2011/09/22 10:28:29 - Spoon - Asking for repository
    2011/09/22 10:28:29 - RepositoriesMeta - No repositories file found in the local directory: /Users/phanf/Toolbox_x/pentaho/data-integration_4.2.0/repositories.xml
    2011/09/22 10:28:29 - RepositoriesMeta - Reading repositories XML file: /Users/phanf/.kettle/repositories.xml
    2011/09/22 10:28:29 - RepositoriesMeta - We have 0 connections...
    2011/09/22 10:28:29 - RepositoriesMeta - We have 2 repositories...
    2011/09/22 10:28:29 - RepositoriesMeta - Looking at repository #0
    2011/09/22 10:28:29 - RepositoriesMeta - Read at repository: defID
    2011/09/22 10:28:29 - RepositoriesMeta - Looking at repository #1
    2011/09/22 10:28:29 - RepositoriesMeta - Read at repository: pentaho2
    2011/09/22 10:28:33 - Spoon - Trying to open the last file used.
    2011/09/22 10:28:33 - Spoon - Auto loading transformation test from repository directory /
    2011/09/22 10:28:33 - Transformation metadata - The shared object fie [null] is empty!
    2011/09/22 10:28:33 - Transformation metadata - We have 1 connections...
    2011/09/22 10:28:33 - Transformation metadata - Looking at connection #0
    2011/09/22 10:28:33 - Transformation metadata - Reading 1 steps...
    2011/09/22 10:28:33 - Transformation metadata - Looking at step #0
    2011/09/22 10:28:33 - Transformation metadata - We have 0 hops...
    2011/09/22 10:28:33 - Transformation metadata - nr of steps read : 1
    2011/09/22 10:28:33 - Transformation metadata - nr of hops  read : 0
    2011/09/22 10:29:27 - /test - Transformation is pre-loaded.
    2011/09/22 10:29:27 - /test - nr of steps to run : 2  , nr of hops : 1
    2011/09/22 10:29:27 - /test - Dispatching started for transformation [/test]
    2011/09/22 10:29:27 - /test - This is not a replay transformation
    2011/09/22 10:29:27 - /test - I found 2 different steps to launch.
    2011/09/22 10:29:27 - /test - Allocating rowsets...
    2011/09/22 10:29:27 - /test -  Allocating rowsets for step 0 --> Table input
    2011/09/22 10:29:27 - /test -   prevcopies = 1, nextcopies=1
    2011/09/22 10:29:27 - /test - Transformation allocated new rowset [Table input.0 - dummy.0]
    2011/09/22 10:29:27 - /test -  Allocated 1 rowsets for step 0 --> Table input  
    2011/09/22 10:29:27 - /test -  Allocating rowsets for step 1 --> dummy
    2011/09/22 10:29:27 - /test -  Allocated 1 rowsets for step 1 --> dummy  
    2011/09/22 10:29:27 - /test - Allocating Steps & StepData...
    2011/09/22 10:29:27 - /test -  Transformation is about to allocate step [Table input] of type [TableInput]
    2011/09/22 10:29:27 - /test -   Step has nrcopies=1
    2011/09/22 10:29:27 - Table input.0 - distribution activated
    2011/09/22 10:29:27 - Table input.0 - Starting allocation of buffers & new threads...
    2011/09/22 10:29:27 - Table input.0 - Step info: nrinput=0 nroutput=1
    2011/09/22 10:29:27 - Table input.0 - output rel. is  1:1
    2011/09/22 10:29:27 - Table input.0 - Found output rowset [Table input.0 - dummy.0]
    2011/09/22 10:29:27 - Table input.0 - Finished dispatching
    2011/09/22 10:29:27 - /test -  Transformation has allocated a new step: [Table input].0
    2011/09/22 10:29:27 - /test -  Transformation is about to allocate step [dummy] of type [Dummy]
    2011/09/22 10:29:27 - /test -   Step has nrcopies=1
    2011/09/22 10:29:27 - dummy.0 - distribution activated
    2011/09/22 10:29:27 - dummy.0 - Starting allocation of buffers & new threads...
    2011/09/22 10:29:27 - dummy.0 - Step info: nrinput=1 nroutput=0
    2011/09/22 10:29:27 - dummy.0 - Got previous step from [dummy] #0 --> Table input
    2011/09/22 10:29:27 - dummy.0 - input rel is 1:1
    2011/09/22 10:29:27 - dummy.0 - Found input rowset [Table input.0 - dummy.0]
    2011/09/22 10:29:27 - dummy.0 - Finished dispatching
    2011/09/22 10:29:27 - /test -  Transformation has allocated a new step: [dummy].0
    2011/09/22 10:29:27 - /test - This transformation can be replayed with replay date: 2011/09/22 10:29:27
    2011/09/22 10:29:27 - /test - Initialising 2 steps...
    2011/09/22 10:29:27 - Table input.0 - Running on slave server #0/1.
    2011/09/22 10:29:27 - dummy.0 - Running on slave server #0/1.
    2011/09/22 10:29:27 - CNET91 EmpImport - New database connection defined
    2011/09/22 10:29:27 - CNET91 EmpImport - Connected to database.
    2011/09/22 10:29:27 - CNET91 EmpImport - Auto commit off
    2011/09/22 10:29:27 - Table input.0 - Connected to database...
    2011/09/22 10:29:27 - /test - Step [Table input.0] initialized flawlessly.
    2011/09/22 10:29:27 - /test - Step [dummy.0] initialized flawlessly.
    2011/09/22 10:29:27 - Table input.0 - Starting to run...
    2011/09/22 10:29:27 - dummy.0 - Starting to run...
    2011/09/22 10:29:27 - /test - Transformation has allocated 2 threads and 1 rowsets.
    2011/09/22 10:29:27 - Table input.0 - SQL query : SELECT
    2011/09/22 10:29:27 - Table input.0 -   EMPLID
    2011/09/22 10:29:27 - Table input.0 - , LAST_NAME
    2011/09/22 10:29:27 - Table input.0 - , FIRST_MIDDLE_NAME
    2011/09/22 10:29:27 - Table input.0 - , TITLE
    2011/09/22 10:29:27 - Table input.0 - , DEPARTMENT_ID
    2011/09/22 10:29:27 - Table input.0 - , DEPARTMENT
    2011/09/22 10:29:27 - Table input.0 - , PHONE
    2011/09/22 10:29:27 - Table input.0 - , EMAIL_ADDR
    2011/09/22 10:29:27 - Table input.0 - , STATUS
    2011/09/22 10:29:27 - Table input.0 - , ADDRESS
    2011/09/22 10:29:27 - Table input.0 - , CITY
    2011/09/22 10:29:27 - Table input.0 - , "STATE"
    2011/09/22 10:29:27 - Table input.0 - , ZIPCODE
    2011/09/22 10:29:27 - Table input.0 - , COUNTRY
    2011/09/22 10:29:27 - Table input.0 - , SUPERVISOR_ID
    2011/09/22 10:29:27 - Table input.0 - , REG_TEMP
    2011/09/22 10:29:27 - Table input.0 - , FULL_PART_TIME
    2011/09/22 10:29:27 - Table input.0 - , COMPANY_NAME
    2011/09/22 10:29:27 - Table input.0 - , LOCATION
    2011/09/22 10:29:27 - Table input.0 - , TERM_DATE
    2011/09/22 10:29:27 - Table input.0 - , NT_LOGIN
    2011/09/22 10:29:27 - Table input.0 - , LOC_ID
    2011/09/22 10:29:27 - Table input.0 - , LAST_UPDATED
    2011/09/22 10:29:27 - Table input.0 - , COST_CENTER
    2011/09/22 10:29:27 - Table input.0 - , CNET_DIVISION
    2011/09/22 10:29:27 - Table input.0 - , CNET_BUSINESS_UNIT
    2011/09/22 10:29:27 - Table input.0 - , DEPT_SETID
    2011/09/22 10:29:27 - Table input.0 - , EXEMPT_STATUS
    2011/09/22 10:29:27 - Table input.0 - , CNET_WORKFLOOR
    2011/09/22 10:29:27 - Table input.0 - , CNET_WORKSTATION
    2011/09/22 10:29:27 - Table input.0 - , corpDirID
    2011/09/22 10:29:27 - Table input.0 - , FTE
    2011/09/22 10:29:27 - Table input.0 - FROM PS_CURRENT
    2011/09/22 10:29:27 - CNET91 EmpImport - Statement canceled!
    2011/09/22 10:29:27 - CNET91 EmpImport - Statement canceled!
    Here's the log for when Preview does work, which seems rare and only when the table is being queried for the very first time after PDI start up:
    Code:
    2011/09/22 10:30:48 - Spoon - Logging goes to file:///var/folders/WI/WIMeCRnXGPesGlzgt+f0ck+++TM/-Tmp-/spoon_9c572834-e540-11e0-ac53-9976365f503d.log
    2011/09/22 10:30:48 - DBCache - Loading database cache from file: [/Users/phanf/.kettle/db.cache]
    2011/09/22 10:30:48 - DBCache - We read 0 cached rows from the database cache!
    2011/09/22 10:30:49 - class org.pentaho.agilebi.platform.JettyServer - WebServer.Log.CreateListener localhost:10000
    2011/09/22 10:30:50 - Spoon - Asking for repository
    2011/09/22 10:30:50 - Version checker - OK
    2011/09/22 10:30:51 - RepositoriesMeta - No repositories file found in the local directory: /Users/phanf/Toolbox_x/pentaho/data-integration_4.2.0/repositories.xml
    2011/09/22 10:30:51 - RepositoriesMeta - Reading repositories XML file: /Users/phanf/.kettle/repositories.xml
    2011/09/22 10:30:51 - RepositoriesMeta - We have 0 connections...
    2011/09/22 10:30:51 - RepositoriesMeta - We have 2 repositories...
    2011/09/22 10:30:51 - RepositoriesMeta - Looking at repository #0
    2011/09/22 10:30:51 - RepositoriesMeta - Read at repository: defID
    2011/09/22 10:30:51 - RepositoriesMeta - Looking at repository #1
    2011/09/22 10:30:51 - RepositoriesMeta - Read at repository: pentaho2
    2011/09/22 10:30:54 - Spoon - Trying to open the last file used.
    2011/09/22 10:30:54 - Spoon - Auto loading transformation test from repository directory /
    2011/09/22 10:30:54 - Transformation metadata - The shared object fie [null] is empty!
    2011/09/22 10:30:54 - Transformation metadata - We have 1 connections...
    2011/09/22 10:30:54 - Transformation metadata - Looking at connection #0
    2011/09/22 10:30:54 - Transformation metadata - Reading 1 steps...
    2011/09/22 10:30:54 - Transformation metadata - Looking at step #0
    2011/09/22 10:30:54 - Transformation metadata - We have 0 hops...
    2011/09/22 10:30:54 - Transformation metadata - nr of steps read : 1
    2011/09/22 10:30:54 - Transformation metadata - nr of hops  read : 0
    2011/09/22 10:31:03 - /test - Transformation is pre-loaded.
    2011/09/22 10:31:03 - /test - nr of steps to run : 2  , nr of hops : 1
    2011/09/22 10:31:03 - /test - Dispatching started for transformation [/test]
    2011/09/22 10:31:03 - /test - This is not a replay transformation
    2011/09/22 10:31:03 - /test - I found 2 different steps to launch.
    2011/09/22 10:31:03 - /test - Allocating rowsets...
    2011/09/22 10:31:03 - /test -  Allocating rowsets for step 0 --> Table input
    2011/09/22 10:31:03 - /test -   prevcopies = 1, nextcopies=1
    2011/09/22 10:31:03 - /test - Transformation allocated new rowset [Table input.0 - dummy.0]
    2011/09/22 10:31:03 - /test -  Allocated 1 rowsets for step 0 --> Table input  
    2011/09/22 10:31:03 - /test -  Allocating rowsets for step 1 --> dummy
    2011/09/22 10:31:03 - /test -  Allocated 1 rowsets for step 1 --> dummy  
    2011/09/22 10:31:03 - /test - Allocating Steps & StepData...
    2011/09/22 10:31:03 - /test -  Transformation is about to allocate step [Table input] of type [TableInput]
    2011/09/22 10:31:03 - /test -   Step has nrcopies=1
    2011/09/22 10:31:03 - Table input.0 - distribution activated
    2011/09/22 10:31:03 - Table input.0 - Starting allocation of buffers & new threads...
    2011/09/22 10:31:03 - Table input.0 - Step info: nrinput=0 nroutput=1
    2011/09/22 10:31:03 - Table input.0 - output rel. is  1:1
    2011/09/22 10:31:03 - Table input.0 - Found output rowset [Table input.0 - dummy.0]
    2011/09/22 10:31:03 - Table input.0 - Finished dispatching
    2011/09/22 10:31:03 - /test -  Transformation has allocated a new step: [Table input].0
    2011/09/22 10:31:03 - /test -  Transformation is about to allocate step [dummy] of type [Dummy]
    2011/09/22 10:31:03 - /test -   Step has nrcopies=1
    2011/09/22 10:31:03 - dummy.0 - distribution activated
    2011/09/22 10:31:03 - dummy.0 - Starting allocation of buffers & new threads...
    2011/09/22 10:31:03 - dummy.0 - Step info: nrinput=1 nroutput=0
    2011/09/22 10:31:03 - dummy.0 - Got previous step from [dummy] #0 --> Table input
    2011/09/22 10:31:03 - dummy.0 - input rel is 1:1
    2011/09/22 10:31:03 - dummy.0 - Found input rowset [Table input.0 - dummy.0]
    2011/09/22 10:31:03 - dummy.0 - Finished dispatching
    2011/09/22 10:31:03 - /test -  Transformation has allocated a new step: [dummy].0
    2011/09/22 10:31:03 - /test - This transformation can be replayed with replay date: 2011/09/22 10:31:03
    2011/09/22 10:31:03 - /test - Initialising 2 steps...
    2011/09/22 10:31:03 - dummy.0 - Running on slave server #0/1.
    2011/09/22 10:31:03 - Table input.0 - Running on slave server #0/1.
    2011/09/22 10:31:03 - CNET91 EmpImport - New database connection defined
    2011/09/22 10:31:03 - CNET91 EmpImport - Connected to database.
    2011/09/22 10:31:03 - CNET91 EmpImport - Auto commit off
    2011/09/22 10:31:03 - Table input.0 - Connected to database...
    2011/09/22 10:31:03 - /test - Step [Table input.0] initialized flawlessly.
    2011/09/22 10:31:03 - /test - Step [dummy.0] initialized flawlessly.
    2011/09/22 10:31:03 - /test - Transformation has allocated 2 threads and 1 rowsets.
    2011/09/22 10:31:03 - Table input.0 - Starting to run...
    2011/09/22 10:31:03 - dummy.0 - Starting to run...
    2011/09/22 10:31:03 - Table input.0 - SQL query : SELECT
    2011/09/22 10:31:03 - Table input.0 -   EMPLID
    2011/09/22 10:31:03 - Table input.0 - , LAST_NAME
    2011/09/22 10:31:03 - Table input.0 - , FIRST_MIDDLE_NAME
    2011/09/22 10:31:03 - Table input.0 - , TITLE
    2011/09/22 10:31:03 - Table input.0 - , DEPARTMENT_ID
    2011/09/22 10:31:03 - Table input.0 - , DEPARTMENT
    2011/09/22 10:31:03 - Table input.0 - , PHONE
    2011/09/22 10:31:03 - Table input.0 - , EMAIL_ADDR
    2011/09/22 10:31:03 - Table input.0 - , STATUS
    2011/09/22 10:31:03 - Table input.0 - , ADDRESS
    2011/09/22 10:31:03 - Table input.0 - , CITY
    2011/09/22 10:31:03 - Table input.0 - , "STATE"
    2011/09/22 10:31:03 - Table input.0 - , ZIPCODE
    2011/09/22 10:31:03 - Table input.0 - , COUNTRY
    2011/09/22 10:31:03 - Table input.0 - , SUPERVISOR_ID
    2011/09/22 10:31:03 - Table input.0 - , REG_TEMP
    2011/09/22 10:31:03 - Table input.0 - , FULL_PART_TIME
    2011/09/22 10:31:03 - Table input.0 - , COMPANY_NAME
    2011/09/22 10:31:03 - Table input.0 - , LOCATION
    2011/09/22 10:31:03 - Table input.0 - , TERM_DATE
    2011/09/22 10:31:03 - Table input.0 - , NT_LOGIN
    2011/09/22 10:31:03 - Table input.0 - , LOC_ID
    2011/09/22 10:31:03 - Table input.0 - , LAST_UPDATED
    2011/09/22 10:31:03 - Table input.0 - , COST_CENTER
    2011/09/22 10:31:03 - Table input.0 - , CNET_DIVISION
    2011/09/22 10:31:03 - Table input.0 - , CNET_BUSINESS_UNIT
    2011/09/22 10:31:03 - Table input.0 - , DEPT_SETID
    2011/09/22 10:31:03 - Table input.0 - , EXEMPT_STATUS
    2011/09/22 10:31:03 - Table input.0 - , CNET_WORKFLOOR
    2011/09/22 10:31:03 - Table input.0 - , CNET_WORKSTATION
    2011/09/22 10:31:03 - Table input.0 - , corpDirID
    2011/09/22 10:31:03 - Table input.0 - , FTE
    2011/09/22 10:31:03 - Table input.0 - FROM PS_CURRENT
    2011/09/22 10:31:04 - CNET91 EmpImport - Statement canceled!
    2011/09/22 10:31:04 - Table input.0 - Stopped while putting a row on the buffer
    2011/09/22 10:31:04 - CNET91 EmpImport - Statement canceled!
    What's going on? How is anyone suppose to debug this?

    (I'm running Data Integration 64-bit 4.2.0 on Mac OS X Snow Leopard. I went to 4.2.0 after encountering the problem on 4.1.0.)
    Last edited by fphan; 09-22-2011 at 02:16 PM.

  2. #2
    Join Date
    Sep 2011
    Posts
    1

    Default

    Same problem here. Anybody?

  3. #3
    Join Date
    Sep 2009
    Posts
    810

    Default

    Hi there,

    would you be able to look into the stdout/stderr outputs? On mac OSX you'd have to start PDI using ./spoon.sh from terminal. That's not going to work out of the box, but if you provide the proper swt libraries and add -XstartOnFirstThread as a first parameter to the java call, it will start.

    (if that does not make any sense to you, I'm attaching a spoon.sh I modified from the 4.2. release)
    spoon.zip
    Once you start spoon from spoon.sh I'm curious about the stdout/stderr text. It sometimes contains errors that don't end up in the log.

    Cheers
    Slawo

  4. #4
    Join Date
    Apr 2013
    Posts
    6

    Default

    I'm seeing the same problem with the "Stopped while putting a row on the buffer"
    It works 1 time and then it doesn't work anymore.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.