Hitachi Vantara Pentaho Community Forums
Results 1 to 10 of 10

Thread: Unknown column 'ID_STEP_ATTRIBUTE'

  1. #1
    Join Date
    Mar 2007
    Posts
    3

    Default Unknown column 'ID_STEP_ATTRIBUTE'

    I am saving my transformations and jobs in an Oracle repository and I am using PDI 3.0.1 on Windows 2000. In a transformation I read a field from an Excel file and pass it to a calculator to separate the year and month from the given fiield. My test trasnformation now has just the Excel input, and the calculator. I started removing steps to isolate the problem and found that if the calculator is involved then the error appears. I get an Unknown column 'ID_STEP_ATTRIBUTE' error.

    Detailed logging shows this:

    2007/12/15 12:22:28 - Transformation 1 - Looking for the transformation [Transformation 1] in directory [/]
    2007/12/15 12:22:29 - Transformation 1 - Loading transformation [Transformation 1] from repository...
    2007/12/15 12:22:29 - SharedObjects - Reading the shared objects file [file:///C:/Documents and Settings/Administrator/.kettle/shared.xml]
    2007/12/15 12:22:29 - Transformation 1 - Loading step with ID: 7
    2007/12/15 12:22:29 - Transformation 1 - Loading step with ID: 8
    2007/12/15 12:22:29 - Transformation 1 - ERROR (version 3.0.1, build 534 from 2007/12/12 12:28:23) : A database error occured reading a transformation from the repository
    2007/12/15 12:22:29 - Transformation 1 - ERROR (version 3.0.1, build 534 from 2007/12/12 12:28:23) : org.pentaho.di.core.exception.KettleValueException:
    2007/12/15 12:22:29 - Transformation 1 - ERROR (version 3.0.1, build 534 from 2007/12/12 12:28:23) : Unknown column 'ID_STEP_ATTRIBUTE'

    I also tested with MySql as the repository with the same results so this is not Oracle specific.

    This transformation works fine from an xml definition (no repository). In this case the transforation log looks like this:

    2007/12/15 12:26:47 - SharedObjects - Reading the shared objects file [file:///C:/Documents and Settings/Administrator/.kettle/shared.xml]
    2007/12/15 12:26:47 - Spoon - Transformation opened.
    2007/12/15 12:26:47 - Spoon - Launching transformation [teste]...
    2007/12/15 12:26:47 - Spoon - Started the transformation execution.
    2007/12/15 12:26:47 - teste - Dispatching started for transformation [teste]
    2007/12/15 12:26:47 - teste - Nr of arguments detected:0
    2007/12/15 12:26:47 - teste - This is not a replay transformation
    2007/12/15 12:26:47 - teste - I found 2 different steps to launch.
    2007/12/15 12:26:47 - teste - Allocating rowsets...
    2007/12/15 12:26:47 - teste - Allocating rowsets for step 0 --> Acha Perêodo
    2007/12/15 12:26:47 - teste - prevcopies = 1, nextcopies=1
    2007/12/15 12:26:47 - teste - Transformation allocated new rowset [Acha Perêodo.0 - Periodo.0]
    2007/12/15 12:26:47 - teste - Allocated 1 rowsets for step 0 --> Acha Perêodo
    2007/12/15 12:26:47 - teste - Allocating rowsets for step 1 --> Periodo
    2007/12/15 12:26:47 - teste - Allocated 1 rowsets for step 1 --> Periodo
    2007/12/15 12:26:47 - teste - Allocating Steps & StepData...
    2007/12/15 12:26:47 - teste - Transformation is about to allocate step [Acha Perêodo] of type [ExcelInput]
    2007/12/15 12:26:47 - Acha Perêodo.0 - Starting allocation of buffers & new threads...
    2007/12/15 12:26:47 - Acha Perêodo.0 - Step info: nrinput=0 nroutput=1
    2007/12/15 12:26:47 - Acha Perêodo.0 - output rel. is 1:1
    2007/12/15 12:26:47 - Acha Perêodo.0 - Found output rowset [Acha Perêodo.0 - Periodo.0]
    2007/12/15 12:26:47 - Acha Perêodo.0 - Finished dispatching
    2007/12/15 12:26:47 - teste - Transformation has allocated a new step: [Acha Perêodo].0
    2007/12/15 12:26:47 - teste - Transformation is about to allocate step [Periodo] of type [Calculator]
    2007/12/15 12:26:47 - Periodo.0 - distribution activated
    2007/12/15 12:26:47 - Periodo.0 - Starting allocation of buffers & new threads...
    2007/12/15 12:26:47 - Periodo.0 - Step info: nrinput=1 nroutput=0
    2007/12/15 12:26:47 - Periodo.0 - Got previous step from [Periodo] #0 --> Acha Perêodo
    2007/12/15 12:26:47 - Periodo.0 - input rel is 1:1
    2007/12/15 12:26:47 - Periodo.0 - Found input rowset [Acha Perêodo.0 - Periodo.0]
    2007/12/15 12:26:47 - Periodo.0 - Finished dispatching
    2007/12/15 12:26:47 - teste - Transformation has allocated a new step: [Periodo].0
    2007/12/15 12:26:47 - teste - This transformation can be replayed with replay date: 2007/12/15 12:26:47
    2007/12/15 12:26:47 - teste - Initialising 2 steps...
    2007/12/15 12:26:47 - Acha Perêodo.0 - Running on slave server #0/1.
    2007/12/15 12:26:47 - Periodo.0 - Running on slave server #0/1.
    2007/12/15 12:26:47 - teste - Step [Acha Perêodo.0] initialized flawlessly.
    2007/12/15 12:26:47 - teste - Step [Periodo.0] initialized flawlessly.
    2007/12/15 12:26:47 - teste - Transformation has allocated 2 threads and 1 rowsets.
    2007/12/15 12:26:47 - Acha Perêodo.0 - Starting to run...
    2007/12/15 12:26:47 - Acha Perêodo.0 - Opening openFile #0 : C:\download\pipeline\Plant_PipeLine.xls
    2007/12/15 12:26:47 - Periodo.0 - Starting to run...
    2007/12/15 12:26:48 - Acha Perêodo.0 - Get sheet #0.0
    2007/12/15 12:26:48 - Acha Perêodo.0 - Row limit of [1] reached: stop processing.
    2007/12/15 12:26:49 - Periodo.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
    2007/12/15 12:26:49 - Acha Perêodo.0 - Finished processing (I=0, O=0, R=0, W=1, U=0, E=0)
    2007/12/15 12:26:49 - Spoon - The transformation has finished!!

    Due to several business reasons I need to have the ETL in an Oracle repository. Is there something I can do to solve this?

    Thanks.

  2. #2
    Join Date
    Mar 2007
    Posts
    3

    Default

    An additional bit of information I found after I posted is that when you try to open the transforation from a SQL repository you can not do it because of the error. However here there was more information which may be of use:

    java.lang.reflect.InvocationTargetException: Error loading transformation
    at org.pentaho.di.ui.trans.dialog.TransLoadProgressDialog$1.run(TransLoadProgressDialog.java:81)
    at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:369)
    at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:313)
    at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:495)
    at org.pentaho.di.ui.trans.dialog.TransLoadProgressDialog.open(TransLoadProgressDialog.java:89)
    at org.pentaho.di.ui.spoon.Spoon.loadLastUsedFile(Spoon.java:5728)
    at org.pentaho.di.ui.spoon.Spoon.lastFileSelect(Spoon.java:1215)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:585)
    at org.pentaho.xul.EventHandler.handleMenuEvent(EventHandler.java:44)
    at org.pentaho.xul.swt.menu.MenuBar.handleMenuEvent(MenuBar.java:52)
    at org.pentaho.xul.swt.menu.Menu.handleMenuEvent(Menu.java:117)
    at org.pentaho.xul.swt.menu.MenuChoice.handleMenuEvent(MenuChoice.java:77)
    at org.pentaho.xul.swt.menu.MenuChoice.handleEvent(MenuChoice.java:73)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:841)
    at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:5589)
    at org.pentaho.di.ui.spoon.Spoon.run(Spoon.java:5685)
    at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:371)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:585)
    at org.pentaho.commons.launcher.Launcher.main(Launcher.java:116)
    Caused by: org.pentaho.di.core.exception.KettleException:
    An error occured reading a transformation from the repository
    Unknown column 'ID_STEP_ATTRIBUTE'

  3. #3
    Join Date
    May 2006
    Posts
    4,882

    Default

    Something must have gone wrong in the repository creation/upgrade. Rerun repository creation in another schema or on another database and try again.

    Regards,
    Sven

  4. #4
    Join Date
    Oct 2007
    Posts
    10

    Default hi sven,

    this is exactly the same issue i was having - i received the same error both in an upgraded repository and a newly created repository.

    see the following post:


    http://forums.pentaho.org/showthread...753#post176753

  5. #5
    Join Date
    May 2006
    Posts
    4,882

    Default

    Running a repository on oracle 10g, haven't seen the problem yet.

    Regards,
    Sven

  6. #6
    Join Date
    Oct 2007
    Posts
    10

    Default I confirm the calculator issue

    Hi all,

    i can confirm that the issue is with the calculator step.

    When removed from the transformation, i had no issue saving and reloading the transformation from database.

  7. #7
    Join Date
    May 2006
    Posts
    4,882

    Default

    Tried creating a new repository on Oracle 10g... no problems saving/loading transformations... maybe you can attacy the transformation on which you have problems.

    Regards,
    Sven

  8. #8
    Join Date
    Oct 2007
    Posts
    10

    Default the transformation

    Hi sven,
    this is the transformation i am having issues with.
    I confirm the issu both on PostgreSQL and MySQL, even with a new repository (on a new database for both).

    I am currently running spoon on linux with jdk1.6.03.
    Attached Files Attached Files

  9. #9
    Join Date
    May 2006
    Posts
    4,882

    Default

    Saving that in a repository triggers it for me... now make a jira for it at http://jira.pentaho.org/browse/PDI

    AND try to delete the calculator step and redo that one

    Found it... when you don't specify a conversioin mask on a calculator step function in v3.0 some kind of backwards compatibility tries to kick in and fails.

    Regards,
    Sven
    Last edited by sboden; 12-15-2007 at 02:17 PM.

  10. #10
    Join Date
    May 2006
    Posts
    4,882

    Default

    Bug report created: http://jira.pentaho.org/browse/PDI-578

    Regards,
    Sven

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.