Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: (Data Validation step) One validation to many fields

  1. #1
    Join Date
    May 2013
    Posts
    4

    Default (Data Validation step) One validation to many fields

    I have a huge Excel file that I want to apply the same validation rule to all fields before importing to database.
    Is there a easy way to do this in PDI? Currently im using Data validation step and replicating the validation rule to each field.

    Thank you

  2. #2
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    Alternatively you can transform the Excel rows into key/value format and apply your test to the value field only.
    I wonder how many columns your Excel sheet has, and what single test you want apply to all values...
    So long, and thanks for all the fish.

  3. #3
    Join Date
    May 2013
    Posts
    4

    Default

    Quote Originally Posted by marabu View Post
    Alternatively you can transform the Excel rows into key/value format and apply your test to the value field only.
    I wonder how many columns your Excel sheet has, and what single test you want apply to all values...
    Thank you very much for your response!
    Actually in this first validation step I am just checking if all data are numeric and follow a generic format because there is some rubbish inside like 'NA', '-', 'none', something like that. And i want to treat this records in a separated flow.
    I thought would exist some way to apply the same validation rule to many fields.
    Last edited by newtonsbm; 05-27-2013 at 02:19 PM.

  4. #4
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    The only additional way I see is a Scripting step.
    So long, and thanks for all the fish.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.