PDA

View Full Version : Using Single Threader Step in map-reduce Transform



better
09-26-2013, 11:11 AM
In order to use the Single Threader step, you have to reference the sub-transformation by its filename. How do I do this when the main transform will be running as a map-reduce? If I simply try:


${Internal.Transformation.Filename.Directory}\SubTransformation.ktr
Map-reduce complains with:


ERROR 26-09 10:24:27,587 - Process Children - Unable to load the mapping transformation because of an error : org.pentaho.di.core.exception.KettleException: Unable to load the specified mapping

Unable to read file [file:///data8/mapred/local/taskTracker/BEtter/jobcache/job_201309241008_0139/attempt_201309241008_0139_m_000000_0/work/${Internal.Transformation.Filename.Directory}/SubTransformation.ktr]
Could not read from "file:///data8/mapred/local/taskTracker/BEtter/jobcache/job_201309241008_0139/attempt_201309241008_0139_m_000000_0/work/${Internal.Transformation.Filename.Directory}/SubTransformation.ktr" because it is a not a file.

It's looking for the file in the cache, but I don't know how to put it there.