Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Which steps used to transfer data on partitioned table?

  1. #1
    Join Date
    Oct 2013
    Posts
    216

    Post Which steps used to transfer data on partitioned table?

    HI,

    I have a big table on source and destination side.

    I have to transfer records from source to destination daily based on updated records.

    On destination side table is partitioned.

    So which jobs i have to use to transfer data?

    Is there any good approach that help me to handle this ?
    -- NITIN --

  2. #2
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    Table Input, and Table Output. (Select from Source -> Table Output in Destination)
    Perhaps
    Table Input, Table Input, Table Output. (Select Max(UpdateDate) from Destination -> Select From Source where UpdateDate > <MaxUpdateDate> -> Table Output )

    Now... Are you going to do manual partitions? ie. OutputTable201401, OutputTable201402, OutputTable201403 ... There's a checkbox in TableOutput to do this. Alternatively, your DBA can design the Database to partition the data on the destination side.
    **THIS IS A SIGNATURE - IT GETS POSTED ON (ALMOST) EVERY POST**
    I'm no expert.
    Take my comments at your own risk.

    PDI user since PDI 3.1
    PDI on Windows 7 & Linux

    Please keep in mind (and this may not apply to this thread):
    No forum member is going to do your work for you. We will help you sort out how to do a specific part of the work, as best we can, in the timelines that our work will allow us.
    Signature Updated: 2014-06-30

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.