Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Wait for a file on a FTP server

  1. #1
    Join Date
    Jun 2008
    Posts
    7

    Default Wait for a file on a FTP server

    Hi,

    I need to get a file generated daily at a 'quite' fixed time of day on a FTP server. The folder contain many other files with no interest in my context.

    What I want is to loop on the FTP Get until it managed to get the required file, so I forwarded my OK flow to the next transformation and tried to forward the Failing flow to a wait step that loop back to start of my transformation.

    Then I enabled the "At least we got x files" options with a parameter 1, expecting to fail if my file file was not present... But It doesn't look like it is failing, even when no file has actually been downloaded


    Am I missing something with this "At least we got x files" option?

    Thanks
    Attached Images Attached Images  

  2. #2
    Join Date
    Feb 2009
    Posts
    3

    Default Please Help

    Hi
    I'm new to this Kettle. I need some help as u have did something over this.

    I want to coy only those text files from the FTP which has not earlier copied from the FTP. I'm copying those text files to local system and inserting the data from the text files to the database. So I want to pass some parameter which i have retrived from database like the last inserted data's date which is in the file name.
    The file name extensions like ACDCallDetail2009_02_12.txt. So how to find the fresh text files only.The FTP server contains no. of files which is unnecessary for me.

    Please help to find the solution.

    thanks...

  3. #3
    Join Date
    May 2006
    Posts
    4,882

    Default

    ftp (in general) does not support that kind of processing.

    So it's either
    - Remove the files after process.... fetch file, process file, delete file on success.
    - Or ftp all and do some local processing.
    - Some other combination where people ftp the files to you, instead of you ftp'ing from them, or some server side cleanup jobs, ...

    Regards,
    Sven

    P.S Don't hi-jack old threads... it's easier if you start a new thread for a new problem.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.