Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Please help with setting up a Normaliser transformation

  1. #1

    Question Please help with setting up a Normaliser transformation

    Please take a look at my attached transformation to help me understand what I am doing wrong in setting up a Row Normalisertransformation.

    I am using a query to select the source data in the format below:

    +------------------+-------------------+-------------+
    | source_rubric_id | source_element_id | standards |
    +------------------+-------------------+-------------+
    | 1 | 2 | AR-T.5 ,ATT-E5,AT.5 |
    | 1 | 3 | IL.1,IL.1.A |
    +------------------+-------------------+-------------+


    The standards element has to be split into separate rows. The attached transformation uses Javascript to parse the standards by “,” followed by a normaliser step to create new rows for each parsed values.

    Till this point, I am having trouble getting pass an exception which is indicating to me that I have it set up incorrectly.

    Please take a look to see if you can identify what I have done wrong.

    Thanks!
    Attached Files Attached Files
    Last edited by wburrell; 12-30-2007 at 11:32 PM. Reason: updated the attached transformation and log file

  2. #2

    Default Updated the attached transformation and log file

    I continued to try to get the normaliser to work; but with no success. My latest efforts are attached.
    Attached Files Attached Files

  3. #3
    Join Date
    May 2006
    Posts
    4,882

    Default

    - Make a copy of your job, remove everything after Java Script value and add a text output behind it. Run the job again. (possibly anonymyze the data a bit)
    - Then remove also the first 2 steps and replace them with a text input file using the input file of step 1.
    - Reduce the input file until you get just enough data to show the problem.

    - Attach input file and changed transformation.

    We need something we can test without using databases.

    Regards,
    Sven

  4. #4

    Default

    I attached a modified transformation that references the attached input text file.

    Ideally I would like to do away with the limit of 10 normalized rows and have a way to dynamically add the number of rows based on the number of strings split from the “Standards” element. There is a possibility of there being more that 10 associated values. My plan with the current approach is to delete the rows that are inserted with values of “NOSTANADARD”.

    I welcome all better recommendations.
    Attached Files Attached Files
    Last edited by wburrell; 01-02-2008 at 05:54 PM.

  5. #5

    Default I used a JavaScript instead of the Row Normalizer

    I was able to dynamically create new rows via JavaScript. FYI see the attached transformation.

    Attached Files Attached Files

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.