Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: CloseIT SAS reader - new PDI plugin

  1. #1
    Join Date
    Sep 2017
    Posts
    3

    Default CloseIT SAS reader - new PDI plugin

    Hello,

    I want to introduce you new plugin "CloseIT SAS reader" developed by our company and based on Parso library (http://lifescience.opensource.epam.com/parso.html).

    As obvious, it is intended for reading SAS files (.sas7bdat) and have features like:


    • support for compressed SAS files
    • column order independence (if column order in sas file is changed, than no config update in plugin is neccesary)
    • column renaming


    You can find more on https://github.com/CloseITsro/pdi-sa...r-(PDI-plugin) .

    GitHub repo: https://github.com/CloseITsro/pdi-sas-reader

    Name:  SAS_reader.jpg
Views: 101
Size:  24.2 KB

  2. #2
    Join Date
    Jan 2018
    Posts
    1

    Default

    Hi,
    we've added a new feature - optional columns. When the input SAS data set is delivered from outside, it will likely be in the incorrect format for different reasons. Columns can be reordered (that's why our step is independent on the column order) or some columns may be missing. That's why the step checks if all defined columns are present and if not, transformation ends with error (you can in fact trigger this check by button Verify this transformation).

    On the other hand, some columns can be optional. If you mark them as optional, they will skip the presence check and they won't be included in the output row.

    In order to use this feature, you have to build the step from source (1.2.0-SNAPSHOT). We would also like to hear your opinion on the step. Do you use it in your project? Do you find it better than default SAS input step? Do you have any idea for new features? You can directly help us with development on GitHub or just give us your input. Thanks.

    Ludek

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.