Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: What is the proper "ETL way" of caching and re-using webservice results?

  1. #1

    Question What is the proper "ETL way" of caching and re-using webservice results?

    I need to look-up a value from a table, if it's not there, then call a slowish web service to look it up, and cache the results in the table so it'll be there for quick use next time.

    I've been struggling with a few variations of this and they have all been too complicated (high maintenance), buggy, or both.

    So I'm thinking of scrapping whatever I tried and starting over. This must be a common pattern. Are there any examples I can readily adapt to my purposes?

    Ideal solution would be a Step where I define the Web Service call and a Results Caching Table in one go.

  2. #2
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    I would use HSQLDB for this.
    So long, and thanks for all the fish.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.