text file input - regex with deep hierarchy

[amol_pathak]

Hi,

I am new to kettle.

I have to load data from the files (say - a.txt) which are placed inside various directories/levels (say - dir11,dir12,dir12) - all under certain directory (dir1)

In *nix, I would have given `find . -name "a.txt"` to search such files.

>tree dir1

dir11
|---------a.txt
|---------b.txt
dir12
|---------a.txt
dir13
|----------a.txt

Want to know if it is possible find and load them using text file input task ? What should be the regex for the this ?

regds,
Amol


#2
Today, 01:55 PM
MattCasters vbmenu_register("postmenu_161732", true);
Chief Data Integration
Join Date: Nov 1999
Posts: 2,727



Technically it became very easy using the new VFS libs, but we didn't enable the feature yet because of backward compatibility issues.
Can I suggest you execute the find statement and send it to a file, say "filelist.txt"?
Then you can read that file and send the filenames to the Text File Input step

HTH,

Matt

P.S. And please file a feature request for it as well ;-)