Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Passing 'files'/ rows to a job entry one at a time

  1. #1
    Join Date
    Sep 2014
    Posts
    175

    Default Passing 'files'/ rows to a job entry one at a time

    Hi there--

    I basically have a transformation that finds all files in a certain folder that match a pattern, and attempts to upload them to a database.

    I can easily pass these to another transformation using 'Get File Names' -> Copy rows to result. Then the next transformation, use Advanced > Execute for every input row, then 'Get rows from result'.


    Well now I'm thinking - I need to pass these file names to a full blown Job (job entry), not just another transformation. I'm confused at how to do the same thing.

    I can do Execute for Every input row again, but I'm wondering - does 'Get rows from the result' still work in any transformation in this sub-Job? Or do I need to configure something else? I guess I can test a few things out but wanted to put this out --- I'm not exactly sure how this works in an easily explainable fashion.

  2. #2
    Join Date
    Apr 2016
    Posts
    156

    Default

    Yes, the "Send xyz to results" should work in another (sub)-job that has (sub-)transformations that "Get xyz from result".

    Since you're dealing with filenames... are you converting the filename/path to a String, then sending those rows (w/ String containing name) to result? If so, then definitely continue using Copy Rows To Result / Get Rows From Result.

    Alternatively, if the step you're using to read file names sends the File Names to result, then make sure you use "Get Files from Result" (can play around w/ 'Set Files in Result', although probably not needed).

    EDIT: confirmed on 6.1 + 7.0; not sure about earlier versions.
    Last edited by adamnyc; 11-15-2016 at 04:28 PM. Reason: specified PDI version
    My runtime environment: MacOS, JDK 1.8u121, PDI 7.0

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.