Hitachi Vantara Pentaho Community Forums
Results 1 to 18 of 18

Thread: JMS Plugin for PDI

  1. #1
    Join Date
    Jan 2007
    Posts
    10

    Default JMS Plugin for PDI

    We have developed a new JMS PlugIn, Which dequeue all messages from JMS server using specified parameters from dialog. But There is a problem with plugIn.
    When We execute our JMS PlugIn using Debug mode it gets all inputs from metadata and works fine. In this case metadata object reference is same everywhere.
    When We execute our JMS PlugIn using Run mode it does not get inputs from metadata. In this case metadata object references are different.
    FYI we are using PDI 3.2.0
    Can you please help in this?.

  2. #2
    Join Date
    May 2006
    Posts
    4,882

    Default

    Pretty hard for us to "debug" of course... also no hunches, I don't think the metadata is changed between run and debug mode.

    Regards,
    Sven

  3. #3
    pstoellberger Guest

    Default

    Will you publish this plugin to the rest of the world?

  4. #4
    Join Date
    Mar 2006
    Posts
    170

    Thumbs up I would like to use your Plugin as Well!

    JMS was something I would love to have access to via PDI.

    Please for the sake of us all :-)

    Good Luck and keep me posted!

    Thanks

    Kent

  5. #5
    Join Date
    Jan 2007
    Posts
    10

    Default

    Issue is Fixed, it was a small mistake i had done in saveRep() method.

  6. #6
    pstoellberger Guest

    Default

    Ah ok.

    And are you thinking about publishing this plugin?

  7. #7
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Pentaho created a solution with a combination of the BI Server and PDI. I'll ask around in a few weeks when I'm in Orlando.

  8. #8

    Default

    It may still prove useful, particularly if running transformations/jobs from within Spoon/Kitchen/Carte.

  9. #9
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    The thing is: you can't. You need a dedicated service that subscribes to a JMS queue.
    In theory you could make a never-ending job that passes JMS payloads to transformations, but I don't see it as an ideal situation.

    Then again, I'm no JMS expert ;-)

  10. #10

    Default

    Ah, I was thinking JMS subscriber as the plugin to do batch-operation (run all the waiting items in a queue, or 10 items in a queue), versus event-driven ETL.

    Yeah, event-driven ETL needs to be a persistent service (i.e. BI Server).

  11. #11
    Join Date
    Sep 2009
    Posts
    4

    Default

    Is there any ready to use JMS plug-in available ?

    Thanks

  12. #12
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Pentaho has one in a source code tree somewhere. :-)

  13. #13
    Join Date
    Sep 2009
    Posts
    4

    Default

    Can someone guide me how to access that ? Appreciate your help.


    Thanks

  14. #14
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Call Pentaho sales.

  15. #15
    Join Date
    Mar 2010
    Posts
    18

    Default Event driven ETL

    Hi,

    "Pentaho created a solution with a combination of the BI Server and PDI" - Triggering PDI with a service listening to events/data from JMS/Webservice/others would be a really neat and powerful way to do data integration. Would somebody be kind enough to post links to how I can do this?

    Thank you,

    Vid

  16. #16
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    I'm pleased to say that our upcoming book Pentaho Kettle Solutions will describe how to use JMS in Kettle.
    For those that can't wait, we have a few steps that come along with the enterprise edition version of PDI and updates for the 4.0 release as well.

    Matt

  17. #17
    Join Date
    Mar 2010
    Posts
    18

    Default

    Perfect. The book will be available Sep 2010. Is there a way to purchase an early copy?

    Vid

  18. #18
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    You can probably pre-order it on Amazon etc.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.