Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: ZooKeeper available but no active master location found

  1. #1
    Join Date
    Apr 2014
    Posts
    11

    Default ZooKeeper available but no active master location found

    Hi

    Downloaded DI and started:
    ./spoon.sh
    Got a nice GUI. I am trying to configure Hbase connection to Hortonworks sandbox 2.0
    Name:  Screen Shot 2014-04-10 at 13.20.53.jpg
Views: 630
Size:  30.3 KB

    When I press Get table names I will have log:
    ...
    INFO 10-04 12:43:47,671 - Initiating client connection, connectString=sandbox.hortonworks.com:2181 sessionTimeout=180000 watcher=hconnection
    INFO 10-04 12:43:47,672 - Opening socket connection to server sandbox.hortonworks.com/0:0:0:0:0:0:0:1:2181
    WARN 10-04 12:43:47,672 - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
    java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
    INFO 10-04 12:43:48,467 - Opening socket connection to server sandbox.hortonworks.com/127.0.0.1:2181
    INFO 10-04 12:43:48,467 - Socket connection established to sandbox.hortonworks.com/127.0.0.1:2181, initiating session
    INFO 10-04 12:43:48,478 - Session establishment complete on server sandbox.hortonworks.com/127.0.0.1:2181, sessionid = 0x1453145e950005e, negotiated timeout = 40000
    INFO 10-04 12:43:48,486 - ZooKeeper available but no active master location found
    INFO 10-04 12:43:48,486 - getMaster attempt 0 of 10 failed; retrying after sleep of 1000
    org.apache.hadoop.hbase.MasterNotRunningException
    ...

    I tried with my own custom java code from the same machine\
    1 import org.apache.hadoop.conf.Configuration;
    2 import org.apache.hadoop.hbase.HBaseConfiguration;
    3 import org.apache.hadoop.hbase.HColumnDescriptor;
    4 import org.apache.hadoop.hbase.HTableDescriptor;
    5 import org.apache.hadoop.hbase.client.HBaseAdmin;
    6 import org.apache.hadoop.hbase.util.Bytes;
    7
    8 public class Hbase_connect {
    9
    10 public static void main(String[] args) throws Exception {
    11 Configuration conf = HBaseConfiguration.create();
    12 conf.set("hbase.zookeeper.quorum", "sandbox.hortonworks.com");
    13 conf.set("hbase.zookeeper.property.clientPort", "2181");
    14 conf.set("hbase.rootdir", "hdfs://sandbox.hortonworks.com:8020/apps/hbase/data");
    15 conf.set("zookeeper.znode.parent", "/hbase-unsecure");
    16 HBaseAdmin admin = new HBaseAdmin(conf);
    17 HTableDescriptor[] tabdesc = admin.listTables();
    18 for(int i=0; i<tabdesc.length; i++) {
    19 System.out.println("Table = " + new String(tabdesc [i].getName()));
    20 }
    21 }
    22 }
    margusja@IRack:~/java/hbase_connect$ ls -lah libs/
    total 160264
    drwxr-xr-x 6 margusja staff 204B Apr 5 22:09 .
    drwxr-xr-x 6 margusja staff 204B Apr 10 13:23 ..
    -rw-r--r-- 1 margusja staff 2.5K Oct 7 2013 hadoop-client-2.2.0.jar
    -rw-r--r-- 1 margusja staff 2.6M Apr 5 22:08 hadoop-common-2.2.0.2.0.6.0-76.jar
    drwxr-xr-x 4 margusja staff 136B Apr 5 19:40 hbase-0.96.2-hadoop2
    -rw-r--r-- 1 margusja staff 76M Apr 4 02:18 hbase-0.96.2-hadoop2-bin.tar.gz

    margusja@IRack:~/java/hbase_connect$ java -cp ./:./libs/*:./libs/hbase-0.96.2-hadoop2/lib/* Hbase_connect
    2014-04-10 13:31:56.917 java[5611:1703] Unable to load realm info from SCDynamicStore
    2014-04-10 13:31:56,959 WARN [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    2014-04-10 13:31:57,112 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
    2014-04-10 13:31:57,112 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:host.name=10.10.5.8
    2014-04-10 13:31:57,113 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.version=1.7.0_09
    2014-04-10 13:31:57,113 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.vendor=Oracle Corporation
    2014-04-10 13:31:57,113 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.7.0_09.jdk/Contents/Home/jre
    2014-04-10 13:31:57,113 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.class.path=./:./libs/hadoop-client-2.2.0.jar:./libs/hadoop-common-2.2.0.2.0.6.0-76.jar:./libs/hbase-0.96.2-hadoop2/lib/activation-1.1.jar:./libs/hbase-0.96.2-hadoop2/lib/aopalliance-1.0.jar:./libs/hbase-0.96.2-hadoop2/lib/asm-3.1.jar:./libs/hbase-0.96.2-hadoop2/lib/avro-1.7.4.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-beanutils-1.7.0.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-beanutils-core-1.8.0.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-cli-1.2.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-codec-1.7.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-collections-3.2.1.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-compress-1.4.1.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-configuration-1.6.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-daemon-1.0.13.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-digester-1.8.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-el-1.0.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-httpclient-3.1.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-io-2.4.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-lang-2.6.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-logging-1.1.1.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-math-2.1.jar:./libs/hbase-0.96.2-hadoop2/lib/commons-net-3.1.jar:./libs/hbase-0.96.2-hadoop2/lib/findbugs-annotations-1.3.9-1.jar:./libs/hbase-0.96.2-hadoop2/lib/gmbal-api-only-3.0.0-b023.jar:./libs/hbase-0.96.2-hadoop2/lib/grizzly-framework-2.1.2.jar:./libs/hbase-0.96.2-hadoop2/lib/grizzly-http-2.1.2.jar:./libs/hbase-0.96.2-hadoop2/lib/grizzly-http-server-2.1.2.jar:./libs/hbase-0.96.2-hadoop2/lib/grizzly-http-servlet-2.1.2.jar:./libs/hbase-0.96.2-hadoop2/lib/grizzly-rcm-2.1.2.jar:./libs/hbase-0.96.2-hadoop2/lib/guava-12.0.1.jar:./libs/hbase-0.96.2-hadoop2/lib/guice-3.0.jar:./libs/hbase-0.96.2-hadoop2/lib/guice-servlet-3.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-annotations-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-auth-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-client-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-common-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-hdfs-2.2.0-tests.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-hdfs-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-mapreduce-client-app-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-mapreduce-client-common-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-mapreduce-client-core-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-mapreduce-client-jobclient-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-mapreduce-client-shuffle-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-yarn-api-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-yarn-client-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-yarn-common-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-yarn-server-common-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hadoop-yarn-server-nodemanager-2.2.0.jar:./libs/hbase-0.96.2-hadoop2/lib/hamcrest-core-1.3.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-client-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-common-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-examples-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-hadoop-compat-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-hadoop2-compat-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-it-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-prefix-tree-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-protocol-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-server-0.96.2-hadoop2-tests.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-server-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-shell-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-testing-util-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/hbase-thrift-0.96.2-hadoop2.jar:./libs/hbase-0.96.2-hadoop2/lib/htrace-core-2.04.jar:./libs/hbase-0.96.2-hadoop2/lib/httpclient-4.1.3.jar:./libs/hbase-0.96.2-hadoop2/lib/httpcore-4.1.3.jar:./libs/hbase-0.96.2-hadoop2/lib/jackson-core-asl-1.8.8.jar:./libs/hbase-0.96.2-hadoop2/lib/jackson-jaxrs-1.8.8.jar:./libs/hbase-0.96.2-hadoop2/lib/jackson-mapper-asl-1.8.8.jar:./libs/hbase-0.96.2-hadoop2/lib/jackson-xc-1.8.8.jar:./libs/hbase-0.96.2-hadoop2/lib/jamon-runtime-2.3.1.jar:./libs/hbase-0.96.2-hadoop2/lib/jasper-compiler-5.5.23.jar:./libs/hbase-0.96.2-hadoop2/lib/jasper-runtime-5.5.23.jar:./libs/hbase-0.96.2-hadoop2/lib/javax.inject-1.jar:./libs/hbase-0.96.2-hadoop2/lib/javax.servlet-3.1.jar:./libs/hbase-0.96.2-hadoop2/lib/javax.servlet-api-3.0.1.jar:./libs/hbase-0.96.2-hadoop2/lib/jaxb-api-2.2.2.jar:./libs/hbase-0.96.2-hadoop2/lib/jaxb-impl-2.2.3-1.jar:./libs/hbase-0.96.2-hadoop2/lib/jersey-client-1.9.jar:./libs/hbase-0.96.2-hadoop2/lib/jersey-core-1.8.jar:./libs/hbase-0.96.2-hadoop2/lib/jersey-grizzly2-1.9.jar:./libs/hbase-0.96.2-hadoop2/lib/jersey-guice-1.9.jar:./libs/hbase-0.96.2-hadoop2/lib/jersey-json-1.8.jar:./libs/hbase-0.96.2-hadoop2/lib/jersey-server-1.8.jar:./libs/hbase-0.96.2-hadoop2/lib/jersey-test-framework-core-1.9.jar:./libs/hbase-0.96.2-hadoop2/lib/jersey-test-framework-grizzly2-1.9.jar:./libs/hbase-0.96.2-hadoop2/lib/jets3t-0.6.1.jar:./libs/hbase-0.96.2-hadoop2/lib/jettison-1.3.1.jar:./libs/hbase-0.96.2-hadoop2/lib/jetty-6.1.26.jar:./libs/hbase-0.96.2-hadoop2/lib/jetty-sslengine-6.1.26.jar:./libs/hbase-0.96.2-hadoop2/lib/jetty-util-6.1.26.jar:./libs/hbase-0.96.2-hadoop2/lib/jruby-complete-1.6.8.jar:./libs/hbase-0.96.2-hadoop2/lib/jsch-0.1.42.jar:./libs/hbase-0.96.2-hadoop2/lib/jsp-2.1-6.1.14.jar:./libs/hbase-0.96.2-hadoop2/lib/jsp-api-2.1-6.1.14.jar:./libs/hbase-0.96.2-hadoop2/lib/jsr305-1.3.9.jar:./libs/hbase-0.96.2-hadoop2/lib/junit-4.11.jar:./libs/hbase-0.96.2-hadoop2/lib/libthrift-0.9.0.jar:./libs/hbase-0.96.2-hadoop2/lib/log4j-1.2.17.jar:./libs/hbase-0.96.2-hadoop2/lib/management-api-3.0.0-b012.jar:./libs/hbase-0.96.2-hadoop2/lib/metrics-core-2.1.2.jar:./libs/hbase-0.96.2-hadoop2/lib/netty-3.6.6.Final.jar:./libs/hbase-0.96.2-hadoop2/lib/paranamer-2.3.jar:./libs/hbase-0.96.2-hadoop2/lib/protobuf-java-2.5.0.jar:./libs/hbase-0.96.2-hadoop2/lib/servlet-api-2.5-6.1.14.jar:./libs/hbase-0.96.2-hadoop2/lib/slf4j-api-1.6.4.jar:./libs/hbase-0.96.2-hadoop2/lib/slf4j-log4j12-1.6.4.jar:./libs/hbase-0.96.2-hadoop2/lib/snappy-java-1.0.4.1.jar:./libs/hbase-0.96.2-hadoop2/lib/xmlenc-0.52.jar:./libs/hbase-0.96.2-hadoop2/lib/xz-1.0.jar:./libs/hbase-0.96.2-hadoop2/lib/zookeeper-3.4.5.jar
    2014-04-10 13:31:57,114 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.library.path=/Users/margusja/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
    2014-04-10 13:31:57,115 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.io.tmpdir=/var/folders/vm/5pggdh2x3_s_l6z55brtql3h0000gn/T/
    2014-04-10 13:31:57,115 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.compiler=<NA>
    2014-04-10 13:31:57,115 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environments.name=Mac OS X
    2014-04-10 13:31:57,115 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environments.arch=x86_64
    2014-04-10 13:31:57,115 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environments.version=10.9.2
    2014-04-10 13:31:57,116 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:user.name=margusja
    2014-04-10 13:31:57,116 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:user.home=/Users/margusja
    2014-04-10 13:31:57,116 INFO [main] zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:user.dir=/Users/margusja/java/hbase_connect
    2014-04-10 13:31:57,119 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181 sessionTimeout=30000 watcher=hconnection-0x586fb16d, quorum=sandbox.hortonworks.com:2181, baseZNode=/hbase-unsecure
    2014-04-10 13:31:57,145 INFO [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x586fb16d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181
    2014-04-10 13:32:02,222 INFO [main-SendThread(fe80:0:0:0:0:0:0:1%1:2181)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(966)) - Opening socket connection to server fe80:0:0:0:0:0:0:1%1/fe80:0:0:0:0:0:0:1%1:2181. Will not attempt to authenticate using SASL (unknown error)
    2014-04-10 13:32:02,229 WARN [main-SendThread(fe80:0:0:0:0:0:0:1%1:2181)] zookeeper.ClientCnxn (ClientCnxn.java:run(1089)) - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
    java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
    2014-04-10 13:32:02,338 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(966)) - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
    2014-04-10 13:32:02,339 WARN [main-SendThread(localhost:2181)] zookeeper.ClientCnxn (ClientCnxn.java:run(1089)) - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
    java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
    2014-04-10 13:32:02,346 WARN [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:retryOrThrow(253)) - Possibly transient ZooKeeper, quorum=sandbox.hortonworks.com:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase-unsecure/hbaseid
    2014-04-10 13:32:02,346 INFO [main] util.RetryCounter (RetryCounter.java:sleepUntilNextRetry(155)) - Sleeping 1000ms before retry #0...
    2014-04-10 13:32:02,441 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(966)) - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
    2014-04-10 13:32:02,442 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn (ClientCnxn.javarimeConnection(849)) - Socket connection established to localhost/127.0.0.1:2181, initiating session
    2014-04-10 13:32:02,457 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn (ClientCnxn.javanConnected(1207)) - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x1453145e950006e, negotiated timeout = 30000
    2014-04-10 13:32:04,340 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
    Table = ambarismoketest
    Table = mytable
    Table = simple_hcat_load_table
    Table = users
    Table = weblogs

    Any hint?

    Best regards, Margusja

  2. #2
    Join Date
    Apr 2014
    Posts
    11

    Default

    Okey - more reading and less writing
    Updated DI big_data_plugin and set right parameters into plugin.properties got it finally work

    Best regards, Margusja

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.