Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Working with denormalized data

  1. #1
    Join Date
    Oct 2011
    Posts
    1

    Default Working with denormalized data

    I have a large number of denormalized files, that look very much like the example in the Row Normalizer step:

    http://wiki.pentaho.com/display/EAI/Row+Normalizer

    However the step requires that the field names be manually configured. I don't understand how this can be practically used, since the number of fields in a denormalized table is variable: it depends on the number of rows in the normalized tables (e.g. product table in the example). If I had a hundred files, each with a different set of "product" fields, how would I import them?

    I have the same question about the Row Denormalizer step. The number of output fields depends on the number of rows in the product table. But the step requires this to be manually configured.

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Version 4.2 fortunately adds support for both mentioned steps to the Metadata Injection system. It allows you to dynamically do the row normalization for all hundreds of files with a single transformation template.
    See examples elsewhere on this forum and in the samples/transformations/meta-inject folder.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.