Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Significant performance difference in executing a transformation locally or via Carte

  1. #1

    Default Significant performance difference in executing a transformation locally or via Carte

    Hi,

    I have seen the following behaviour: I have got a transformation which is performing an Insert/Update at the end and is part of a job. When I am executing the job locally or via Carte, the Insert/Update step achives roundabout 23 r/s (target database is Postgres). But when I am executing the transformation directly on the Carte server, the step has a performance of about 400 r/s.

    Is there a specific reason for this performance difference?
    Regards

    Bobse

  2. #2
    Join Date
    Dec 2012
    Posts
    8

    Default

    This can occur with network latency/bandwidth. If you have carte installed on a server connected by a gigabit network to the postgres server, it will be much faster than connection through a WAN or LAN out to your personal desktop/laptop. We generally always submit to carte in our development environment as our database server is physically located elsewhere.

  3. #3

    Default

    Ok, I get that and that is in fact the situation in my setup here. But that still does not explain, why the transformation executes the step on low speed when being run as part of a job on Carte.

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Let me give a definite answer to your question then: no, there is no specific reason, it's the exact same transformation execution engine for Spoon, Pan and Carte.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.