Hitachi Vantara Pentaho Community Forums
Results 1 to 12 of 12

Thread: Pentaho Integration with GA

  1. #1
    Join Date
    Oct 2015
    Posts
    1

    Default Pentaho Integration with GA

    Hi All,

    I have tried to use google analytics input step and tried running with one date data extraction and it works fine. However, when i did a month to date extraction, the job keeps failing with following error in server. Any idea how to resolve the timeout issue?

    I tried changing the timeout in web.xml in /biserver-ee/tomcat/webapps/pentaho/WEB-INF but it doesnt work. Anyone had similar issue and found solution to it?

    org.pentaho.di.core.exception.KettleException:
    java.net.SocketTimeoutException: Read timed out
    Read timed out


    at org.pentaho.di.trans.steps.googleanalytics.GaInputStep.getNextDataEntry(GaInputStep.java:265)
    at org.pentaho.di.trans.steps.googleanalytics.GaInputStep.processRow(GaInputStep.java:93)
    at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
    at java.lang.Thread.run(Thread.java:744)
    Caused by: java.net.SocketTimeoutException: Read timed out
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:152)
    at java.net.SocketInputStream.read(SocketInputStream.java:122)
    at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
    at sun.security.ssl.InputRecord.read(InputRecord.java:480)
    at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
    at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
    at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
    at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
    at sun.net.http://www.http.HttpClient.parseHTTP...ient.java:687)
    at sun.net.http://www.http.HttpClient.parseHTTP...ient.java:633)
    at sun.net.http://www.protocol.http.HttpURLConn...ion.java:1323)
    at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
    at sun.net.http://www.protocol.https.HttpsURLCo...Impl.java:338)
    at com.google.api.client.http.javanet.NetHttpResponse.<init>(NetHttpResponse.java:37)
    at com.google.api.client.http.javanet.NetHttpRequest.execute(NetHttpRequest.java:94)
    at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:972)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
    at org.pentaho.di.trans.steps.googleanalytics.GaInputStep.getNextDataEntry(GaInputStep.java:261)

  2. #2
    Join Date
    Jan 2007
    Posts
    26

    Default

    Hi,
    I'm experiencing the same issue randomly when running transformation from Spoon or carte server. I use PDI 6.0.0 stable.
    Any hints would be greatly appreciated.
    Radovan

  3. #3

    Default

    Hi,

    I'm having the same issue when using Spoon. I tried in versions 5.4.0.1-130 and 6.0, both give the same error at random moments.
    Does anyone have a solution for that?

    Thank you very much.

  4. #4
    Join Date
    Jan 2014
    Posts
    11

    Default

    Hello,

    I have the same problem. The solution is provided by Google: https://developers.google.com/api-cl...-client/errors

    private HttpRequestInitializer setHttpTimeout(final HttpRequestInitializer requestInitializer) {
    return new HttpRequestInitializer() {
    @Override
    public void initialize(HttpRequest httpRequest) throws IOException {
    requestInitializer.initialize(httpRequest);
    httpRequest.setConnectTimeout(3 * 60000); // 3 minutes connect timeout
    httpRequest.setReadTimeout(3 * 60000); // 3 minutes read timeout
    }
    };

    GoogleCredential credential = ....

    final Analytics analytics = Analytics.builder(new NetHttpTransport(), jsonFactory, setHttpTimeout(credential)).build();
    Anyone has ticked this issue on pentaho jira?

    Thank you

  5. #5

    Default [SOLVED] Jira

    Hi, I've file ticket this bug: http://jira.pentaho.com/browse/PDI-15413
    Including a modified source file needed to solve it.
    Hope it helps!

    PS: Any one still having problems, let us know how can we help

  6. #6

    Default

    Hi,

    I am having this same issue. Is there a way around this until the Jira is addressed?

  7. #7

    Default

    @daniel.garriot: What version of PDI are you using?
    My solution was to recompile the plugin hardcoding a longer timeout. I can't just share my binaries since they probably won't work for you as expected.
    Final solution should include a new field to dynamically set this value at design time, but I've no idea when it will be released.

  8. #8
    Join Date
    Dec 2016
    Posts
    2

    Default

    Could you maybe share the compiled plugin with me by private message? Or just upload it and post it here? Compiling the plugin is quite painful for non-programmer.

  9. #9

    Default

    Private message doesn't allow attachments (at least I couldn't find how).
    You can email me to karel.reynaldo [at] stratebi.com
    And I'll share this .jar with you.

  10. #10
    Join Date
    Dec 2016
    Posts
    2

    Default

    Thank you very much kreynaldo.
    I hope, this will be soon applied as it is to the plugin, should be already for at least 90% of the people fine enough. I was able to load our user/hour since 2013 in one step, before it even timed out in some cases for 7 days.

  11. #11
    Join Date
    Oct 2016
    Posts
    18

    Default

    Hi,

    We are facing the same issue- google Analytic Input step(timeout issue). Could you please share the steps to follow to resolve this?

    Apprecite your help!

    Regards,
    KK

  12. #12
    Join Date
    Oct 2016
    Posts
    18

    Default

    Hi,
    We are facing the same issue(time out) in Google analytic input step and using PDI-7.0 version. Could you please help us to resolve this issue with the steps?

    Thanks in advance....

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.