Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Dump of 39 lakh rows in excel from table input

  1. #1

    Default Dump of 39 lakh rows in excel from table input

    Hi Folks....
    Firstly thank you very much for taking out time to read my post and trying to help me out....
    I am using Kettle CE 4.4

    Our situation is such that we want to take a dump from table which is around 39 lakhs and we want in excel.

    There is a list of restriction for rows given below, request the all you friends to suggest an alternative

    Excel Output Step:
    65k row only

    Excel Writer Step:
    10lakh rows only

    Please suggest if any of you guys have come across this scenario.

    Thank you very much....
    Thank you

    Cheers
    Ronak Shah

  2. #2
    Join Date
    Oct 2010
    Posts
    369

    Default Alternative

    One Alternative is use "Excel Writer " for output and split the rows sets in excel writer to multiple excel files.
    e.g 350k rows will be divided into 4 files 100k in 3 files and 50k in 4th file.
    Find the sample process
    Attached Files Attached Files

  3. #3
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    Quote Originally Posted by rshah20713 View Post
    Excel Output Step:
    65k row only

    Excel Writer Step:
    10lakh rows only
    First, a quick note: lakh is an India specific unit, if you want to be understood correctly, you should use international units.

    The maximum number of rows in an Excel XLS file is 65536 rows. This is not a limitation of PDI, nor of the Excel Output step.
    The maximum number of rows in an Excel XLSX file is 1,048,576 rows. This is not a limitation of PDI, nor of the Excel Writer step.

    With the Excel Writer step, you have the option of "split every ... rows", which will allow you to put 1,000,000 rows in each file, giving 4 files.

  4. #4
    Join Date
    Apr 2008
    Posts
    1,771

    Default

    But the main question would be.. why 4 million rows in an Excel format?
    -- Mick --

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.