Hitachi Vantara Pentaho Community Forums
Results 1 to 16 of 16

Thread: Database connection error for Impala using Pentaho 5 trail version

  1. #1

    Default Database connection error for Impala using Pentaho 5 trail version

    Hi,

    I am getting the following error while trying to do a database connection with Impala from Pentaho, Could you please let me know what is the solution.

    Error connecting to database [impala] : org.pentaho.di.core.exception.KettleDatabaseException:
    Error occured while trying to connect to the database

    Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration


    org.pentaho.di.core.exception.KettleDatabaseException:
    Error occured while trying to connect to the database

    Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration


    at org.pentaho.di.core.database.Database.normalConnect(Database.java:415)
    at org.pentaho.di.core.database.Database.connect(Database.java:353)
    at org.pentaho.di.core.database.Database.connect(Database.java:306)
    at org.pentaho.di.core.database.Database.connect(Database.java:294)
    at org.pentaho.di.core.database.DatabaseFactory.getConnectionTestReport(DatabaseFactory.java:84)
    at org.pentaho.di.core.database.DatabaseMeta.testConnection(DatabaseMeta.java:2459)
    at org.pentaho.ui.database.event.DataHandler.testDatabaseConnection(DataHandler.java:541)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:139)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:123)
    at org.pentaho.ui.xul.swt.tags.SwtButton.access$500(SwtButton.java:26)
    at org.pentaho.ui.xul.swt.tags.SwtButton$4.widgetSelected(SwtButton.java:121)
    at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.eclipse.jface.window.Window.runEventLoop(Window.java:820)
    at org.eclipse.jface.window.Window.open(Window.java:796)
    at org.pentaho.ui.xul.swt.tags.SwtDialog.show(SwtDialog.java:375)
    at org.pentaho.ui.xul.swt.tags.SwtDialog.show(SwtDialog.java:301)
    at org.pentaho.di.ui.core.database.dialog.XulDatabaseDialog.open(XulDatabaseDialog.java:115)
    at org.pentaho.di.ui.core.database.dialog.DatabaseDialog.open(DatabaseDialog.java:62)
    at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.newConnection(SpoonDBDelegate.java:493)
    at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.newConnection(SpoonDBDelegate.java:478)
    at org.pentaho.di.ui.spoon.Spoon.newConnection(Spoon.java:8194)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:139)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:123)
    at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:26)
    at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:88)
    at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)
    at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545)
    at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490)
    at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1227)
    at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7351)
    at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8656)
    at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:625)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134)
    Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
    Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration

    at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:540)
    at org.pentaho.di.core.database.Database.normalConnect(Database.java:399)
    ... 55 more
    Caused by: java.sql.SQLException: Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration
    at org.apache.hive.jdbc.HiveDriver.getActiveDriver(HiveDriver.java:107)
    at org.apache.hive.jdbc.HiveDriver.callWithActiveDriver(HiveDriver.java:121)
    at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:132)
    at java.sql.DriverManager.getConnection(Unknown Source)
    at java.sql.DriverManager.getConnection(Unknown Source)
    at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:528)
    ... 56 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.GeneratedMethodAccessor29.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.apache.hive.jdbc.HiveDriver.getActiveDriver(HiveDriver.java:105)
    ... 61 more
    Caused by: java.lang.RuntimeException: Unable to load JDBC driver of type: hive2
    at org.pentaho.hadoop.shim.common.CommonHadoopShim.getJdbcDriver(CommonHadoopShim.java:109)
    ... 65 more
    Caused by: java.lang.Exception: JDBC driver of type 'hive2' not supported
    at org.pentaho.hadoop.shim.common.CommonHadoopShim.getJdbcDriver(CommonHadoopShim.java:104)
    ... 65 more

    Hostname : 10.136.229.72
    Port : 21050
    Database name : default



    Thanks
    Bharath

  2. #2
    Join Date
    Sep 2012
    Posts
    71

    Default

    Have you selected cdh42 as your active Hadoop configuration? To do so, edit the plugin.properties file under the plugins/pentaho-big-data-plugin folder under the PDI directory.

  3. #3

    Default

    Hi,

    i got the following error after changing the properties to cdh42.

    Error connecting to database [impala] : org.pentaho.di.core.exception.KettleDatabaseException:
    Error occured while trying to connect to the database

    Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration


    org.pentaho.di.core.exception.KettleDatabaseException:
    Error occured while trying to connect to the database

    Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration


    at org.pentaho.di.core.database.Database.normalConnect(Database.java:415)
    at org.pentaho.di.core.database.Database.connect(Database.java:353)
    at org.pentaho.di.core.database.Database.connect(Database.java:306)
    at org.pentaho.di.core.database.Database.connect(Database.java:294)
    at org.pentaho.di.core.database.DatabaseFactory.getConnectionTestReport(DatabaseFactory.java:84)
    at org.pentaho.di.core.database.DatabaseMeta.testConnection(DatabaseMeta.java:2459)
    at org.pentaho.ui.database.event.DataHandler.testDatabaseConnection(DataHandler.java:541)
    at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:139)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:123)
    at org.pentaho.ui.xul.swt.tags.SwtButton.access$500(SwtButton.java:26)
    at org.pentaho.ui.xul.swt.tags.SwtButton$4.widgetSelected(SwtButton.java:121)
    at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.eclipse.jface.window.Window.runEventLoop(Window.java:820)
    at org.eclipse.jface.window.Window.open(Window.java:796)
    at org.pentaho.ui.xul.swt.tags.SwtDialog.show(SwtDialog.java:375)
    at org.pentaho.ui.xul.swt.tags.SwtDialog.show(SwtDialog.java:301)
    at org.pentaho.di.ui.core.database.dialog.XulDatabaseDialog.open(XulDatabaseDialog.java:115)
    at org.pentaho.di.ui.core.database.dialog.DatabaseDialog.open(DatabaseDialog.java:62)
    at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.newConnection(SpoonDBDelegate.java:493)
    at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.newConnection(SpoonDBDelegate.java:478)
    at org.pentaho.di.ui.spoon.Spoon.newConnection(Spoon.java:8194)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:139)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:123)
    at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:26)
    at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:88)
    at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)
    at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545)
    at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490)
    at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1227)
    at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7351)
    at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8656)
    at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:625)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134)
    Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
    Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration

    at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:540)
    at org.pentaho.di.core.database.Database.normalConnect(Database.java:399)
    ... 54 more
    Caused by: java.sql.SQLException: Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration
    at org.apache.hive.jdbc.HiveDriver.getActiveDriver(HiveDriver.java:107)
    at org.apache.hive.jdbc.HiveDriver.callWithActiveDriver(HiveDriver.java:121)
    at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:132)
    at java.sql.DriverManager.getConnection(Unknown Source)
    at java.sql.DriverManager.getConnection(Unknown Source)
    at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:528)
    ... 55 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.hadoop.hive.jdbc.HadoopConfigurationUtil.getActiveConfiguration(HadoopConfigurationUtil.java:120)
    at org.pentaho.hadoop.hive.jdbc.HadoopConfigurationUtil.getActiveHadoopShim(HadoopConfigurationUtil.java:130)
    at org.apache.hive.jdbc.HiveDriver.getActiveDriver(HiveDriver.java:103)
    ... 60 more
    Caused by: org.pentaho.hadoop.shim.ConfigurationException: Unknown Hadoop Configuration: "cdh42"
    at org.pentaho.hadoop.shim.HadoopConfigurationLocator.getConfiguration(HadoopConfigurationLocator.java:495)
    at org.pentaho.hadoop.shim.HadoopConfigurationLocator.getActiveConfiguration(HadoopConfigurationLocator.java:503)
    ... 66 more

    Hostname : 10.136.229.72
    Port : 21050
    Database name : default

    Thanks
    Bharath

  4. #4
    Join Date
    Sep 2012
    Posts
    71

    Default

    This error says you don't have the cdh42 configuration in your pentaho-big-data-plugin/hadoop-configurations/ directory. Which folders exist in this directory? You said you're using Pentaho Data Integration 5.0?

  5. #5

    Default

    cdh42 folder is present in the directory, but i am not sure why it is not picking up the folder location.

  6. #6
    Join Date
    Sep 2012
    Posts
    71

    Default

    In that case the error means something when wrong when loading the JARs in that directory. Have you changed anything in PDI since you downloaded the 5.0 Trial? Have you added, deleted, changed JARs? You shouldn't have to touch the download for Impala except to set your active.hadoop.configuration=cdh42 in plugin.properties. All the other resources (JARs) are already set up for you (that's our Hadoop Adaptive Layer)

  7. #7

    Default

    No Matt, i didn't change anything.

  8. #8
    Join Date
    Sep 2012
    Posts
    71

    Default

    Double-check your connection settings (IP, port, etc.) sometimes the error message is not indicative of the real error (due to https://issues.apache.org/jira/browse/HIVE-4194). Otherwise I'm not really sure what's going on, many people have been successfully using Impala with the cdh42 shim on PDI 5.0.

  9. #9
    Join Date
    Nov 2013
    Posts
    18

    Default

    do change in plugin.properties for your problem ...

    How to get data from Impala and visualize in the Pentaho Visualization. Can somebody give input on it. Thanks in advance.


    I want to visualize data which exists in hadoop component(Hive, Impala).

  10. #10
    Join Date
    Nov 2013
    Posts
    18

    Default

    How to get data from Impala and visualize in the Pentaho Visualization. Can somebody give input on it. Thanks in advance.

    I want to visualize data which exists in hadoop component(Hive, Impala).



    Quote Originally Posted by rudra.bharath View Post
    Hi,

    I am getting the following error while trying to do a database connection with Impala from Pentaho, Could you please let me know what is the solution.

    Error connecting to database [impala] : org.pentaho.di.core.exception.KettleDatabaseException:
    Error occured while trying to connect to the database

    Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration


    org.pentaho.di.core.exception.KettleDatabaseException:
    Error occured while trying to connect to the database

    Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration


    at org.pentaho.di.core.database.Database.normalConnect(Database.java:415)
    at org.pentaho.di.core.database.Database.connect(Database.java:353)
    at org.pentaho.di.core.database.Database.connect(Database.java:306)
    at org.pentaho.di.core.database.Database.connect(Database.java:294)
    at org.pentaho.di.core.database.DatabaseFactory.getConnectionTestReport(DatabaseFactory.java:84)
    at org.pentaho.di.core.database.DatabaseMeta.testConnection(DatabaseMeta.java:2459)
    at org.pentaho.ui.database.event.DataHandler.testDatabaseConnection(DataHandler.java:541)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:139)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:123)
    at org.pentaho.ui.xul.swt.tags.SwtButton.access$500(SwtButton.java:26)
    at org.pentaho.ui.xul.swt.tags.SwtButton$4.widgetSelected(SwtButton.java:121)
    at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.eclipse.jface.window.Window.runEventLoop(Window.java:820)
    at org.eclipse.jface.window.Window.open(Window.java:796)
    at org.pentaho.ui.xul.swt.tags.SwtDialog.show(SwtDialog.java:375)
    at org.pentaho.ui.xul.swt.tags.SwtDialog.show(SwtDialog.java:301)
    at org.pentaho.di.ui.core.database.dialog.XulDatabaseDialog.open(XulDatabaseDialog.java:115)
    at org.pentaho.di.ui.core.database.dialog.DatabaseDialog.open(DatabaseDialog.java:62)
    at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.newConnection(SpoonDBDelegate.java:493)
    at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.newConnection(SpoonDBDelegate.java:478)
    at org.pentaho.di.ui.spoon.Spoon.newConnection(Spoon.java:8194)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:139)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:123)
    at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:26)
    at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:88)
    at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)
    at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545)
    at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490)
    at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1227)
    at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7351)
    at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8656)
    at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:625)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134)
    Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
    Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration

    at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:540)
    at org.pentaho.di.core.database.Database.normalConnect(Database.java:399)
    ... 55 more
    Caused by: java.sql.SQLException: Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration
    at org.apache.hive.jdbc.HiveDriver.getActiveDriver(HiveDriver.java:107)
    at org.apache.hive.jdbc.HiveDriver.callWithActiveDriver(HiveDriver.java:121)
    at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:132)
    at java.sql.DriverManager.getConnection(Unknown Source)
    at java.sql.DriverManager.getConnection(Unknown Source)
    at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:528)
    ... 56 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.GeneratedMethodAccessor29.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.apache.hive.jdbc.HiveDriver.getActiveDriver(HiveDriver.java:105)
    ... 61 more
    Caused by: java.lang.RuntimeException: Unable to load JDBC driver of type: hive2
    at org.pentaho.hadoop.shim.common.CommonHadoopShim.getJdbcDriver(CommonHadoopShim.java:109)
    ... 65 more
    Caused by: java.lang.Exception: JDBC driver of type 'hive2' not supported
    at org.pentaho.hadoop.shim.common.CommonHadoopShim.getJdbcDriver(CommonHadoopShim.java:104)
    ... 65 more

    Hostname : 10.136.229.72
    Port : 21050
    Database name : default



    Thanks
    Bharath

  11. #11
    Join Date
    Nov 2013
    Posts
    18

    Default

    I have created one analyzer report using Impala connection, I am using two tables with 3000, 1000 records respectively.

    while launching analyzer report, i am getting following error:

    Oops. There is too much number crunching required to run your report. If you are using an "Excludes" or "Doesn't Contain" filter, try removing or flipping them to "Include" or "Contains" filter. You can also try turning off subtotals and grand totals.

    I have checked the Impala daemon logs, i didn't find any issue.
    When I checked the Pentaho BI server logs, I found the following error:


    Not sure why this is happening.


    java.sql.SQLException: org.apache.thrift.TApplicationException: ExecuteStatement failed: out of sequence response



    java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.sql.SQLException: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe
    at com.pentaho.analyzer.report.ReportRequestService.get(SourceFile:213)
    at com.pentaho.analyzer.content.controller.j.a(SourceFile:170)
    at com.pentaho.analyzer.content.controller.b.b(SourceFile:189)
    at com.pentaho.analyzer.content.AnalyzerContentGenerator.createContent(SourceFile:123)
    at org.pentaho.platform.web.http.api.resources.GeneratorStreamingOutput.generateContent(GeneratorStreamingOutput.java:229)
    at org.pentaho.platform.web.http.api.resources.GeneratorStreamingOutput.write(GeneratorStreamingOutput.java:156)
    at org.pentaho.platform.web.http.api.resources.GeneratorStreamingOutputProvider.writeTo(GeneratorStreamingOutputProvider.java:58)
    at org.pentaho.platform.web.http.api.resources.GeneratorStreamingOutputProvider.writeTo(GeneratorStreamingOutputProvider.java:37)
    at com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
    at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1479)
    at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1391)
    at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1381)
    at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
    at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:538)
    at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:716)
    at org.pentaho.platform.web.servlet.JAXRSServlet.service(JAXRSServlet.java:111)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
    at org.pentaho.platform.web.servlet.JAXRSServlet.service(JAXRSServlet.java:116)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.PentahoWebContextFilter.doFilter(PentahoWebContextFilter.java:161)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.PentahoRequestContextFilter.doFilter(PentahoRequestContextFilter.java:83)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:378)
    at org.springframework.security.intercept.web.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:109)
    at org.springframework.security.intercept.web.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.ui.ExceptionTranslationFilter.doFilterHttp(ExceptionTranslationFilter.java:101)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.providers.anonymous.AnonymousProcessingFilter.doFilterHttp(AnonymousProcessingFilter.java:105)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.ui.basicauth.BasicProcessingFilter.doFilterHttp(BasicProcessingFilter.java:174)
    at org.pentaho.platform.web.http.security.PentahoBasicProcessingFilter.doFilterHttp(PentahoBasicProcessingFilter.java:88)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.context.HttpSessionContextIntegrationFilter.doFilterHttp(HttpSessionContextIntegrationFilter.java:235)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.pentaho.platform.web.http.filters.HttpSessionPentahoSessionIntegrationFilter.doFilter(HttpSessionPentahoSessionIntegrationFilter.java:265)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.wrapper.SecurityContextHolderAwareRequestFilter.doFilterHttp(SecurityContextHolderAwareRequestFilter.java:91)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.util.FilterChainProxy.doFilter(FilterChainProxy.java:175)
    at org.springframework.security.util.FilterToBeanProxy.doFilter(FilterToBeanProxy.java:99)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at com.pentaho.ui.servlet.SystemStatusFilter.doFilter(SourceFile:72)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:112)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.WebappRootForwardingFilter.doFilter(WebappRootForwardingFilter.java:66)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
    at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
    at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:861)
    at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:606)
    at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
    at java.lang.Thread.run(Unknown Source)
    Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.sql.SQLException: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe
    at java.util.concurrent.FutureTask$Sync.innerGet(Unknown Source)
    at java.util.concurrent.FutureTask.get(Unknown Source)
    at com.pentaho.analyzer.report.ReportRequestService.get(SourceFile:171)
    ... 71 more
    Caused by: java.lang.RuntimeException: java.sql.SQLException: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe
    at com.pentaho.analyzer.service.impl.AnalysisAreaManager.executeQuery(SourceFile:288)
    at com.pentaho.analyzer.report.ReportManagerImpl.parseAndExecuteMDX(SourceFile:296)
    at com.pentaho.analyzer.report.ReportManagerImpl.runReport(SourceFile:120)
    at com.pentaho.analyzer.report.ReportManagerImpl.runReport(SourceFile:92)
    at com.pentaho.analyzer.report.ReportRequestService$2.a(SourceFile:274)
    at com.pentaho.analyzer.report.ReportRequestService$2.call(SourceFile:267)
    at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    ... 1 more
    Caused by: java.sql.SQLException: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe
    at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:187)
    at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:246)
    at sun.reflect.GeneratedMethodAccessor342.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.hadoop.shim.common.DriverProxyInvocationChain$CaptureResultSetInvocationHandler.invoke(DriverProxyInvocationChain.java:449)
    at com.sun.proxy.$Proxy138.executeQuery(Unknown Source)
    at org.apache.commons.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
    at org.apache.commons.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
    at mondrian.rolap.SqlStatement.execute(SqlStatement.java:201)
    at mondrian.rolap.RolapUtil.executeQuery(RolapUtil.java:335)
    at mondrian.rolap.SqlTupleReader.prepareTuples(SqlTupleReader.java:395)
    at mondrian.rolap.SqlTupleReader.readTuples(SqlTupleReader.java:560)
    at mondrian.rolap.RolapNativeSet$SetEvaluator.executeList(RolapNativeSet.java:250)
    at mondrian.rolap.RolapNativeSet$SetEvaluator.execute(RolapNativeSet.java:190)
    at mondrian.olap.fun.NonEmptyCrossJoinFunDef$1.evaluateList(NonEmptyCrossJoinFunDef.java:80)
    at mondrian.calc.impl.AbstractListCalc.evaluate(AbstractListCalc.java:65)
    at mondrian.rolap.RolapResult.evaluateExp(RolapResult.java:989)
    at mondrian.rolap.RolapNamedSetEvaluator.ensureList(RolapNamedSetEvaluator.java:98)
    at mondrian.rolap.RolapNamedSetEvaluator.evaluateTupleIterable(RolapNamedSetEvaluator.java:66)
    at mondrian.mdx.NamedSetExpr$1.evaluateIterable(NamedSetExpr.java:98)
    at mondrian.olap.fun.GenerateFunDef$GenerateListCalcImpl.evaluateList(GenerateFunDef.java:109)
    at mondrian.calc.impl.AbstractListCalc.evaluate(AbstractListCalc.java:65)
    at mondrian.rolap.RolapResult.evaluateExp(RolapResult.java:989)
    at mondrian.rolap.RolapNamedSetEvaluator.ensureList(RolapNamedSetEvaluator.java:98)
    at mondrian.rolap.RolapNamedSetEvaluator.evaluateTupleIterable(RolapNamedSetEvaluator.java:66)
    at mondrian.mdx.NamedSetExpr$1.evaluateIterable(NamedSetExpr.java:98)
    at mondrian.olap.fun.OrderFunDef$CalcImpl.evaluateList(OrderFunDef.java:201)
    at mondrian.calc.impl.AbstractListCalc.evaluate(AbstractListCalc.java:65)
    at mondrian.rolap.RolapResult.evaluateExp(RolapResult.java:989)
    at mondrian.rolap.RolapNamedSetEvaluator.ensureList(RolapNamedSetEvaluator.java:98)
    at mondrian.rolap.RolapNamedSetEvaluator.evaluateTupleIterable(RolapNamedSetEvaluator.java:66)
    at mondrian.mdx.NamedSetExpr$1.evaluateIterable(NamedSetExpr.java:98)
    at mondrian.calc.impl.IterableListCalc.evaluateList(IterableListCalc.java:37)
    at mondrian.rolap.sql.CrossJoinArgFactory.expandNonNative(CrossJoinArgFactory.java:910)
    at mondrian.rolap.sql.CrossJoinArgFactory.checkCrossJoin(CrossJoinArgFactory.java:341)
    at mondrian.rolap.RolapNativeCrossJoin.createEvaluator(RolapNativeCrossJoin.java:105)
    at mondrian.rolap.RolapNativeRegistry.createEvaluator(RolapNativeRegistry.java:56)
    at mondrian.rolap.RolapSchemaReader.getNativeSetEvaluator(RolapSchemaReader.java:681)
    at mondrian.olap.DelegatingSchemaReader.getNativeSetEvaluator(DelegatingSchemaReader.java:269)
    at mondrian.olap.fun.CrossJoinFunDef$CrossJoinIterCalc.evaluateIterable(CrossJoinFunDef.java:173)
    at mondrian.rolap.RolapResult.executeAxis(RolapResult.java:875)
    at mondrian.rolap.RolapResult.evalLoad(RolapResult.java:700)
    at mondrian.rolap.RolapResult.loadMembers(RolapResult.java:656)
    at mondrian.rolap.RolapResult.<init>(RolapResult.java:288)
    at mondrian.rolap.RolapConnection.executeInternal(RolapConnection.java:671)
    at mondrian.rolap.RolapConnection.access$000(RolapConnection.java:51)
    at mondrian.rolap.RolapConnection$1.call(RolapConnection.java:622)
    at mondrian.rolap.RolapConnection$1.call(RolapConnection.java:621)
    ... 5 more

  12. #12
    Join Date
    Aug 2014
    Posts
    7

    Default Hive Data Integration error using Pentaho

    Hello All,

    I am using Bigdata Lite3.0, Pentaho 5.1, CDH5.0. I want to connect Hive tables using Pentaho.

    While trying to connect, i am getting below errors.

    Error connecting to database [Hive] : org.pentaho.di.core.exception.KettleDatabaseException:
    Error occured while trying to connect to the database

    Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration


    org.pentaho.di.core.exception.KettleDatabaseException:
    Error occured while trying to connect to the database

    Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration


    at org.pentaho.di.core.database.Database.normalConnect(Database.java:428)
    at org.pentaho.di.core.database.Database.connect(Database.java:361)
    at org.pentaho.di.core.database.Database.connect(Database.java:314)
    at org.pentaho.di.core.database.Database.connect(Database.java:302)
    at org.pentaho.di.core.database.DatabaseFactory.getConnectionTestReport(DatabaseFactory.java:80)
    at org.pentaho.di.core.database.DatabaseMeta.testConnection(DatabaseMeta.java:2685)
    at org.pentaho.di.ui.core.database.dialog.DatabaseDialog.test(DatabaseDialog.java:109)
    at org.pentaho.di.ui.core.database.wizard.CreateDatabaseWizardPage2.test(CreateDatabaseWizardPage2.java:157)
    at org.pentaho.di.ui.core.database.wizard.CreateDatabaseWizardPage2$3.widgetSelected(CreateDatabaseWizardPage2.java:147)
    at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.eclipse.jface.window.Window.runEventLoop(Window.java:820)
    at org.eclipse.jface.window.Window.open(Window.java:796)
    at org.pentaho.di.ui.core.database.wizard.CreateDatabaseWizard.createAndRunDatabaseWizard(CreateDatabaseWizard.java:111)
    at org.pentaho.di.ui.spoon.Spoon.createDatabaseWizard(Spoon.java:7457)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157)
    at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141)
    at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:43)
    at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:106)
    at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)
    at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545)
    at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490)
    at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402)
    at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1297)
    at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7801)
    at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9130)
    at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:638)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.pentaho.commons.launcher.Launcher.main(Launcher.java:151)
    Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
    Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver)
    Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration

    at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:573)
    at org.pentaho.di.core.database.Database.normalConnect(Database.java:410)
    ... 43 more
    Caused by: java.sql.SQLException: Unable to load Hive Server 2 JDBC driver for the currently active Hadoop configuration
    at org.apache.hive.jdbc.HiveDriver.getActiveDriver(HiveDriver.java:107)
    at org.apache.hive.jdbc.HiveDriver.callWithActiveDriver(HiveDriver.java:121)
    at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:132)
    at java.sql.DriverManager.getConnection(Unknown Source)
    at java.sql.DriverManager.getConnection(Unknown Source)
    at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:555)
    ... 44 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.apache.hive.jdbc.HiveDriver.getActiveDriver(HiveDriver.java:105)
    ... 49 more
    Caused by: java.lang.RuntimeException: Unable to load JDBC driver of type: hive2
    at org.pentaho.hadoop.shim.common.CommonHadoopShim.getJdbcDriver(CommonHadoopShim.java:108)
    ... 54 more
    Caused by: java.lang.Exception: JDBC driver of type 'hive2' not supported
    at org.pentaho.hadoop.shim.common.CommonHadoopShim.getJdbcDriver(CommonHadoopShim.java:104)
    ... 54 more

    Hostname : localhost
    Port : 8888
    Database name : default


    Awaiting for you reply

    Regards,
    Jiten

  13. #13
    Join Date
    Sep 2012
    Posts
    71

    Default

    The solution is similar to what is listed below, except you set active.hadoop.configuration=cdh50. Also you need to change the *-site.xml files in data-integration/plugins/pentaho-big-data-plugin/hadoop-configurations/cdh50 so that the hostname for the Resource Manager matches your setup (looks like localhost from your post).

    There are details on configuring various Hadoop configurations on the Wiki here: http://wiki.pentaho.com/display/BAD/...ro+and+Version

    Hope this helps,
    Matt

  14. #14
    Join Date
    Aug 2014
    Posts
    7

    Default Hive Data Integration error using Pentaho

    Thank you matt for the information. I have changed the plugin.properties file with active.hadoop.configuration=cdh50. But what should i change in hive.xml. My hive.xml looks like as below.

    <configuration><property><name>hive.metastore.local</name><value>false</value></property><property><name>hive.metastore.uris</name><value>thrift://clouderamanager.cdh5.test:9083</value></property><property><name>hive.exec.reducers.bytes.per.reducer</name><value>1073741824</value></property><property><name>hive.support.concurrency</name><value>true</value></property></configuration>

    Please let me know what should i change.....
    I am using hostname as localhost, port as 8888 and database as default...

    Thanks & Regards,
    Jiten Pansara

  15. #15
    Join Date
    Aug 2014
    Posts
    7

    Default

    Hello,

    Can anyone help me to resolve the issue?

  16. #16
    Join Date
    Jun 2015
    Posts
    7

    Default

    This error occurs because pentaho is not able to find the jars. You have to set the jars in the classpath. Check this link, http://www.folkstalk.com/2015/07/unable-to-load-hive-server-2-jdbc-pentaho-kettle.html on how to set the jars in the classpath.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.