Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: How to process a Kettle transformation once per filename

  1. #1
    Join Date
    Dec 2013
    Posts
    4

    Default How to process a Kettle transformation once per filename

    Hello all,

    I'm trying to read multiple XML files from a folder, to compile all the data they have (all of them have the same XML structure), and than save that data MySql Database.


    I have already designed the transformation for reading XML files and process once per file using following link:

    http://www.timbert.net/doku.php?id=t...ansonceperfile


    I need to move the XML files which are already processed or write some logic so that already processed XML are no need to processed again.


    It would be really helpful if someone provide some useful suggestion.


    Thanks in advance, looking forward to reply.

  2. #2
    Join Date
    Nov 2008
    Posts
    271

    Default

    Hi,
    there are a bunch of trans steps and job entries to manage files. An option would be move each file to a "processed-folder", once you have read it.
    Give a look here and here. Other steps can also be useful for similar task, though.
    HTH
    Andrea Torre
    twitter: @andtorg

    join the community on ##pentaho - a freenode irc channel

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.