Hitachi Vantara Pentaho Community Forums
Results 1 to 7 of 7

Thread: Size limit parameter in the XBase input step - Pentaho Data Integration Spoon 2.5.1 -

  1. #1
    Join Date
    Mar 2007
    Posts
    216

    Default [solved]Size limit parameter in the XBase input step - Pentaho Data Integration Spoon

    Hi,

    I try to use a "Extract from XBase file" input step linked with a "Kettle file" output step. There are 650 000+ lines in the DBF file.
    I want 50 000 of them (or any amount that will extract in less than 120s). I tried "size limit" 50 000, 5 000, 500, 50, 5 without seeing the effect. What does the "size limit" parameter ?

    a+, =)
    -=Clément=-

    PS : My Pentaho Data Integration Spoon 2.5.1 is in french, so names could be approximative.
    Last edited by clement; 09-13-2007 at 05:09 AM.

  2. #2
    Join Date
    May 2006
    Posts
    4,882

    Default

    It's as you thought the row limit. If it's not working raise a tracker at http://jira.pentaho.org/browse/PDI

    Regards,
    Sven

  3. #3
    Join Date
    Mar 2007
    Posts
    216

    Post

    Hi,

    Quote Originally Posted by sboden View Post
    It's as you thought the row limit. If it's not working raise a tracker at http://jira.pentaho.org/browse/PDI

    Regards,
    Sven
    Done.
    http://jira.pentaho.org/browse/PDI-156
    Please see attached files for demo (path must be changed).

    a+, =)
    -=Clément=-
    Attached Files Attached Files

  4. #4
    Join Date
    May 2006
    Posts
    4,882

    Default

    This one is fixed in 3.0.0-RC1 and 2.5.2... it was just forgotten in the step itself.

    Mail me if you want a jar file for 2.5.2 or build one from SVN yourself.

    Regards,
    Sven

  5. #5
    Join Date
    Mar 2007
    Posts
    216

    Default Thanks

    Hi,

    Thanks a lot.
    There is a Kettle v2.5.2 and v3.0.0.RC1 ?
    This project goes faster than I can ^^'
    I put [solved] in the first post title.
    I'll use the v3.0.0.RC1 for my further developments (as soon as I get it).
    It is great to work on a tool when the developer team is as reactive as kettle's.

    a+ ,=)
    -=Clément=-
    Last edited by clement; 09-13-2007 at 05:08 AM.

  6. #6
    Join Date
    May 2006
    Posts
    4,882

    Default

    Thanks. v2.5.2 and v3.0.0-RC1 are not out yet. But you can get something as a "nightly build" if you let me know where to send it to (use private mail).

    The nightly 2.5.2 is pretty stable as it's only (normally) used for bugfixes on 2.5.1, v3.0.0-RC1 is probably a week or a couple of weeks away.

    Regards.
    Sven

  7. #7
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Make that a few weeks. :-)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.