Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Multi threaded

  1. #1
    Pooyan Farahani Guest

    Default Multi threaded

    Hi,

    I am looking at the code for MoveFiles, I am wondering whether using the
    KettleVFS would guarantee processing unique files when multi instances of
    this job are reading from the same source folder?


    Many thanks,
    Pooyan

    --
    You received this message because you are subscribed to the Google Groups "kettle-developers" group.
    To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com.
    To unsubscribe from this group, send email to kettle-developers+unsubscribe (AT) g...oups (DOT) com.
    For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en.

  2. #2
    Matt Casters Guest

    Default Re: Multi threaded

    Of-course not

    2011/3/16 Pooyan Farahani <p.farahani (AT) gmail (DOT) com>

    > Hi,
    >
    > I am looking at the code for MoveFiles, I am wondering whether using the
    > KettleVFS would guarantee processing unique files when multi instances of
    > this job are reading from the same source folder?
    >
    >
    > Many thanks,
    > Pooyan
    >
    > --
    > You received this message because you are subscribed to the Google Groups
    > "kettle-developers" group.
    > To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com.
    > To unsubscribe from this group, send email to
    > kettle-developers+unsubscribe (AT) g...oups (DOT) com.
    > For more options, visit this group at
    > http://groups.google.com/group/kettle-developers?hl=en.
    >




    --
    Matt Casters <mcasters (AT) pentaho (DOT) org>
    Chief Data Integration, Kettle founder, Author of Pentaho Kettle
    Solutions<http://www.amazon.com/Pentaho-Kettle-Solutions-Building-Integration/dp/0470635177>
    (Wiley <http://eu.wiley.com/WileyCDA/WileyTitle/productCd-0470635177.html>)
    Fonteinstraat 70, 9400 OKEGEM - Belgium - Cell : +32 486 97 29 37
    Pentaho : The Commercial Open Source Alternative for Business Intelligence

    --
    You received this message because you are subscribed to the Google Groups "kettle-developers" group.
    To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com.
    To unsubscribe from this group, send email to kettle-developers+unsubscribe (AT) g...oups (DOT) com.
    For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en.

  3. #3
    samatar hassan Guest

    Default Re : Multi threaded

    you can use the "check file is locked" job entry to ensure that you can move
    your file




    ________________________________
    De : Matt Casters <mcasters (AT) pentaho (DOT) org>

  4. #4
    Pooyan Farahani Guest

    Default Re: Re : Multi threaded

    Thanks guys,

    On top of ur head, do you have any suggestion for these sort of situations
    when I need to add more workers to process incoming files?

    I was thinking of creating a lock file while the transformation/job hasn't
    finished yet.

    Many thanks,

    On Wed, Mar 16, 2011 at 5:31 PM, samatar hassan <sahass78 (AT) yahoo (DOT) fr> wrote:
    [color=blue]
    > you can use the "check file is locked" job entry to ensure that you can
    > move your file
    >
    > ------------------------------
    > *De :* Matt Casters <mcasters (AT) pentaho (DOT) org>
    > *

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.