mozi characters elimination using pdo

[santhi]

Hi,

Please tell me how can we ignore the mozi characers using pdi

example:������added

I want to load only string "added" to my database, Could you please tell me the PDI step or some logic to load it.

[santhi]

somyhow i got the logic and its working fine. still i am assuming we can simplify it, please tell me if you are able to help on it to simplify.


"user defined java class step" :

public boolean processRow(StepMetaInterface smi, StepDataInterface sdi) throws KettleException
{
if (first){
first = false;
}


Object[] r = getRow();


if (r == null) {
setOutputDone();
return false;
}
r = createOutputRow(r, data.outputRowMeta.size());

String comments = get(Fields.In, "comments").getString(r);


String str = java.text.Normalizer.normalize(comments, java.text.Normalizer.Form.NFD);
str = str.replaceAll("[^\\p{ASCII}]", "");


get(Fields.Out, "NewComments").setValue(r, str);


putRow(data.outputRowMeta, r);


return true;
}

[johanhammink]

You can also use the "Special Character Remover" plugin for that

[santhi]

Hi,

I am trying to install Special Character Remover plugin using Market place store in PDI s/w but it is giving error as (Failed to execute install , see log for detailes)

and after that i have downloaded the plug in from github :

https://anotherreeshu.wordpress.com/2015/01/13/special-character-remover-version-1-1-0-pentaho-kettle-step-plugin/

i restarted the pdi s/w but i am not able to see any step "Special Character Remover" as mentioned in documentation,. Could you please help on this.

Please check the above url, if i am dong any thing wrong , please help me.

[johanhammink]

I was aible to install it from within PDI but you can also download the plugin from here https://www.pentaho.com/marketplace/
Then unzip file and place the downloaded directory SpecialCharacterRemover-ver-1.1.0 into the directory ..\data-integration\plugins\steps