Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: String contains invalid or unsupported UTF8 codepoints

  1. #1
    Join Date
    Dec 2015
    Posts
    21

    Default String contains invalid or unsupported UTF8 codepoints

    Hi All,

    I am getting following error, while trying to load data from Redshift source to Redshift target db.

    2016/01/11 16:47:10 - Table output.0 - Error inserting/updating row
    2016/01/11 16:47:10 - Table output.0 - [Amazon](500310) Invalid operation: String contains invalid or unsupported UTF8 codepoints. Bad UTF8 hex sequence: bf (error 3);

    The special char. that's is giving the above error is "¿" (upside down question mark).

    I couldn't use "ACCEPTINVCHARS" or REGEXP, since I need to capture data as is and not replace the special char.

    Note:
    There is another process created by another team using SAP BODS and for the same record they could push "¿" to redshift.
    They didn't do any config. setting. specially for this purpose.

    Please help.

    Thanks,
    Raji.

  2. #2
    Join Date
    Dec 2015
    Posts
    21

    Default

    Resolved the issue, by adding "-Dfile.encoding=UTF-8" to PENTAHO_DI_JAVA_OPTIONS in spoon.bat as below.


    if "%PENTAHO_DI_JAVA_OPTIONS%"=="" set PENTAHO_DI_JAVA_OPTIONS="-Xms1024m" "-Xmx3G" "-XX:MaxPermSize=1024m" "-XX:NewSize=512M" "-Dfile.encoding=UTF-8"


    set PENTAHO_DI_JAVA_OPTIONS="-Xms1024m" "-Xmx3G" "-XX:MaxPermSize=1024m" "-XX:NewSize=512M" "-Dfile.encoding=UTF-8"

    Thanks all.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.