Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Sort Row step output wrong result

  1. #1
    Join Date
    Nov 2013
    Posts
    10

    Default Sort Row step output wrong result

    Hello, here is the details:

    I use PDI 4.4.0 community binary on Linux

    I have a data file in text format, which contain about 50,000,000 rows.

    I load the data and send it to a Sort Row step, I keep sort cache remain on 1,000,000

    Then I find the result is wrong.

    I change the sort cache to 100,000,000, then I got the right result.

    I see on Jira some people report a issue relative sort cache, is this similar? http://jira.pentaho.com/browse/PDI-10580

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    yes, don't compress your temp files as a work-around. (it's probably slower anyway).

  3. #3
    Join Date
    Nov 2013
    Posts
    10

    Default

    Thanks Matt. I will try workaround.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.