Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: mozi characters elimination using pdo

  1. #1
    Join Date
    Aug 2015
    Posts
    307

    Default mozi characters elimination using pdo

    Hi,

    Please tell me how can we ignore the mozi characers using pdi

    example:������added

    I want to load only string "added" to my database, Could you please tell me the PDI step or some logic to load it.



  2. #2
    Join Date
    Aug 2015
    Posts
    307

    Default

    somyhow i got the logic and its working fine. still i am assuming we can simplify it, please tell me if you are able to help on it to simplify.


    "user defined java class step" :

    public boolean processRow(StepMetaInterface smi, StepDataInterface sdi) throws KettleException
    {
    if (first){
    first = false;
    }


    Object[] r = getRow();


    if (r == null) {
    setOutputDone();
    return false;
    }
    r = createOutputRow(r, data.outputRowMeta.size());

    String comments = get(Fields.In, "comments").getString(r);


    String str = java.text.Normalizer.normalize(comments, java.text.Normalizer.Form.NFD);
    str = str.replaceAll("[^\\p{ASCII}]", "");


    get(Fields.Out, "NewComments").setValue(r, str);


    putRow(data.outputRowMeta, r);


    return true;
    }

  3. #3
    Join Date
    Nov 2009
    Posts
    672

    Default

    You can also use the "Special Character Remover" plugin for that

  4. #4
    Join Date
    Aug 2015
    Posts
    307

    Default

    Hi,

    I am trying to install Special Character Remover plugin using Market place store in PDI s/w but it is giving error as (Failed to execute install , see log for detailes)

    and after that i have downloaded the plug in from github :

    https://anotherreeshu.wordpress.com/2015/01/13/special-character-remover-version-1-1-0-pentaho-kettle-step-plugin/

    i restarted the pdi s/w but i am not able to see any step "Special Character Remover" as mentioned in documentation,. Could you please help on this.

    Please check the above url, if i am dong any thing wrong , please help me.

  5. #5
    Join Date
    Nov 2009
    Posts
    672

    Default

    I was aible to install it from within PDI but you can also download the plugin from here https://www.pentaho.com/marketplace/
    Then unzip file and place the downloaded directory SpecialCharacterRemover-ver-1.1.0 into the directory ..\data-integration\plugins\steps

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2017 Pentaho Corporation. All Rights Reserved.