Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Get data from XML and rowset size

  1. #1
    Join Date
    May 2014
    Posts
    1

    Question Get data from XML and rowset size

    I have a transformation that processes large (~600Mb) XML files, generating up to 10,000 rows for each input row. If I set the rowset size for the transformation, does it affect both the input and output counts?

    I would like the input side to be restricted to just a few rows, but the output to contain all 10,000 items.
    Eric Olsen

  2. #2
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    The number of rows in a rowset (transformation setting on Miscellaneous tab) is used as a size limit for each and every rowset.
    I don't see any problem with the default setting in your case, as long as you don't provide huge amounts of markup as a field value.
    So long, and thanks for all the fish.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.