Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: PDI 5.0 kettle reading excel sheet and csv file

  1. #1
    Join Date
    Apr 2014
    Posts
    1

    Default PDI 5.0 kettle reading excel sheet and csv file

    Hi,

    I have a PDI 5.0 kettle scenario where...

    1. I have a csv Input file with 200 columns.
    2. I have an MS Excel workbook with 10 sheets. In each sheet I will specify only 10 - 15 column names (10-15 column names alone) that are already present in the csv file mentioned above. The column names are same both in csv and excel.
    3. I need to select columns from the csv file that are already specified in the excel sheet and write it to a separate text files.

    4. I need to repeat this step for all sheets present in that excel file. (Read the column names from the excel sheet, Select them from the csv file and writing it to a separate text files)

    Please help me achieve this. I am very new to pentaho.
    Its very very important for me.

    Thanks
    Dhan
    Last edited by Dhan; 04-20-2014 at 08:21 AM.

  2. #2
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    I wouldn't use an Excel workbook to control multiple projections of tabular data contained in a CSV file - a simple property file can do the same and can be edited using a much less resource intensive tool:

    Code:
    projection-1 = field-1,field-3,field-5
    projection-2 = field-1,field-2,field-4
    ...
    You don't specify exactly how the name lists are provided in a sheet: vertical (one name per row) or horizontal (one name per column).
    You will end up to use ETL Metadata injection, so you might as well start to read about it.
    Don't forget to study the job samples coming with your Kettle installation, too.
    If you get stuck during implementing your scenario, attach your results along with some sample input for review by a community member.
    Good luck.
    Last edited by marabu; 04-27-2014 at 01:42 PM.
    So long, and thanks for all the fish.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.