US and Worldwide: +1 (866) 660-7555
Results 1 to 2 of 2

Thread: input step does not supply the rows in time, so processing stepmisses rows.

  1. #1
    begunrom Guest

    Default input step does not supply the rows in time, so processing stepmisses rows.

    I have multiple input steps supplying the rows i want to process. For
    the first input step, we process as normal (1 input row gives 1 output
    row). For the other steps, we consume rows till the value of a
    keyfield changes.

    The problem that i am facing now is that the step is forgetting input
    rows for all steps except step1. It look like the input step has not
    supplied the rows in time. The processing step needs a way to wait
    till it is sure enough rows are present. In my case, it is not needed
    to wait till all rows have arrived.

    What are my options?

    I have code like this (syntax might not be 100% correct as it is not
    an exact copy):
    for (int j=0;j<totalNrOfInputSteps;j++)
    {
    data.InputRows[j]=getRowFrom(data.InputRowSets[j]);
    do { //loop needs to be executed once, because we already
    consumed the first row.

    if (j!=0){/* We do not need another row from step
    1 as we only consume 1 input row per output row*/
    r = getRowFrom(data.InputRowSets[j]);
    }
    } while((r!=null) && (j!=0) && (keyHasChanged);
    /* j!=0 we only consume 1 row of the first input step
    per output row.*/
    }

    --
    You received this message because you are subscribed to the Google Groups "kettle-developers" group.
    To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com.
    To unsubscribe from this group, send email to kettle-developers+unsubscribe (AT) g...oups (DOT) com.
    For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en.

  2. #2
    begunrom Guest

    Default Re: input step does not supply the rows in time, so processing stepmisses rows.

    I forgot to tell that if i run in debug, everything works fine. No
    rows are forgotten. The reason for this is that all rows have arrived
    before the processRow code is executed

    --
    You received this message because you are subscribed to the Google Groups "kettle-developers" group.
    To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com.
    To unsubscribe from this group, send email to kettle-developers+unsubscribe (AT) g...oups (DOT) com.
    For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •