Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Limit the number of pages to be read using REST clinet step

  1. #1
    Join Date
    Oct 2016
    Posts
    21

    Default Limit the number of pages to be read using REST clinet step

    Hi,

    I am able to read data using REST client step available in Pentaho data integration, Howerver I am getting only first page of the data by default. Can you please help me out to get all pages of data using REST Client step.?

    I assume, I should pass some kind of fileter in API, any suggestions ?


    Regards
    Kullayappa.

  2. #2
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    You should consult the API documentation of the webservice to find out how paged results are implemented.
    So long, and thanks for all the fish.

  3. #3
    Join Date
    Oct 2016
    Posts
    21

    Default

    Hi, Thanks for your reply.

    So you mean, I should check with the team who maintains info about these API ?

    Regards
    Kullayappa.

  4. #4
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    Are you accessing a public service?
    There should be an API documentation online, then.
    The webservice development team will not be enthusiastic to help you implementing a REST client with Kettle, I guess.
    Give us a link and we'll see what help we can provide.
    So long, and thanks for all the fish.

  5. #5
    Join Date
    Oct 2016
    Posts
    21

    Default

    Hi,

    I could not help u posting api here but I can explain my problem more here.

    the api which I call will load 100 items in which are available in the first page.
    I have total of 5000 pages where same api will give. now if I want to load all pages in one shot how can I do that?
    or else I would like to mention some intervals for example for first run load 10th page 20th page.... and so on...
    Current situation is I can read only one page at time by including page number for example.....

    https://apiurl/page=10

    in the above url, I can load only 10th page which contains 100 items.... hope you understand the problem.

    Regards
    Kullayappa.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.