Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Double Length Characters

  1. #1
    Join Date
    Jun 2009
    Posts
    22

    Default Double Length Characters

    I have a feed from SAP that I am trying to load into an Oracle database. I am getting some fields that contain data with double-length characters such as "Å." When I try to store that in Oracle, it gives me an error on column size even though the string only has 20 characters (the characters are just too big).

    I could increase my field size but I don't know how many of these characters I will get. Having these characters is also incorrect in the data so I'd like to parse them out.

    Is there an easy way to find "double length" characters in general or will I have to search for each double length character that I come across?

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    It's an Oracle thing. VARCHAR2(20) means 20 bytes, not characters.

    http://www.oracle-base.com/articles/...lization9i.php

  3. #3
    Join Date
    May 2006
    Posts
    4,882

    Default

    My favorite Oracle pet problem

    If you're still at the start of your project, convince your Oracle DBA's to run the target database in UTF8 (AL32UTF8) mode with character length semantics... and all of your problems will go away (if you mainly use Java to access the database).

    If you don't run UTF8 you can work around it, but eventually you will hit a "brick wall". In Oracle 9i e.g. you could possibly need 3 times the space normally allocated (depending on client and server encoding settings), this behaviour changed in Oracle 10g.

    There's an asciify plugin available for PDI (still have to upload the correct version for 3.2) which will try to convert or strip double characters. It was written for something like you want to do.

    Regards,
    Sven

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.