looking for records in table based on inputs from file
I am very new to kettle so apologies if I am missing out on something basic.
I have searched the forums and google in general but not able to find an answer to my problem
I have a db table that I need to look up based on fields that i would receive from a csv file.
The db table looks like this -
Table Name - NAME_CODE_DATA
Columns - NAME_CODE_ID, NAME_ID,CODE,CODE_SOURCE
The input file is a csv which apart from multiple fields, also has CODE and I would like to get the NAME_ID as part of my look up.
These are the things I tried -
1) Merge Join - It took input csv file and table input. I looked up on CODE fields. It didnt work and was extremely slow.
2) Db Look Up - Didnt work. I realized later that it would work only on primary, foreign keys
3) Stream look up - Didnt work again and was very slow in processing.
I am not sure how could I do a merge between two different data sources on a key which is not primary.
Please let me know if you would need any more information.