PDA

View Full Version : Validate Dynamic data input against dynamic layout file



lsdev
06-30-2010, 10:04 AM
Hi everyone,

I currently wanted to define a job that can validate data in a file against a layout defined in another file.

The layout determines the fileds name, fields length, fileds type used in the data file.
The data file contains the corresponding data.

I read some posts explaining identical difficulties like loading dynamically the content of a file un a dynamically defined table. And for now I do not find any solution for that kind of problem.

I determine the file to read using the component getFileName, then filter the result to determine what is the "type" of file.

The transformation read the content of the file but never pass it to the next step. I assume because there is no field defined by default, this assume you know in advance the number of field contained in the input files or the 2 files used in input.
Is there any way to determine it dynamically? or preset the fields in a input file with Kettle?

Kind regards