I have installed Pentaho 6.1.x.x (both PDI and Pentaho Hadoop Shims) on Windows 7 machine. I have also setup Hadoop cluster (HDP2.2 – on Ubuntu) with VMWare workstation on the same Windows 7 machine. I am trying to create a scenario in PDI to read CSV file which is HDFS directory and run some transformation and load the data back on to HDFS directory.

I am trying to test connection from PDI to HDP2.2 for the above scenario and I am getting connection error for Ping Job Tracker / Resource Manager and Cluster Test: Zookeeper. Please refer the logs below and can someone guide on this on how to resolve this. I have installed Pentaho 6.1.x.x (both PDI and Pentaho Hadoop Shims) on Windows 7 machine. I have also setup Hadoop cluster (HDP2.2 – on Ubuntu) with VMWare workstation on the same Windows 7 machine. I am trying to create a scenario in PDI to read CSV file which is HDFS directory and run some transformation and load the data back on to HDFS directory.

I am trying to test connection from PDI to HDP2.2 for the above scenario and I am getting connection error for Ping Job Tracker / Resource Manager and Cluster Test: Zookeeper. Please refer the logs below and can someone guide on this on how to resolve this.

----------------------------
2016/09/01 22:00:10 - CDR-CopyFiles - Finished job entry [Hadoop Copy Files] (result=[false])
2016/09/01 22:00:10 - CDR-CopyFiles - Job execution finished
2016/09/01 22:00:10 - Spoon - Job has ended.
2016/09/01 22:01:25 - Named cluster: horton - Cluster Test: Hadoop Configuration
2016/09/01 22:01:25 - Named cluster: horton - Active Shim Load: INFO Successfully loaded the hdp23 shim.
2016/09/01 22:01:25 - Named cluster: horton - Successfully loaded the hdp23 shim.
2016/09/01 22:01:25 - Named cluster: horton - Shim Configuration Verification: INFO The Hadoop File System URL matches the Active shim.
2016/09/01 22:01:25 - Named cluster: horton - The Hadoop File System URL matches the URL in the shim configuration file.
2016/09/01 22:01:25 - Named cluster: horton - Cluster Test: Hadoop File System
2016/09/01 22:01:25 - Named cluster: horton - Hadoop File System Connection: INFO Successfully connected to host.
2016/09/01 22:01:25 - Named cluster: horton - Successfully connected to 192.168.35.129 at port 8020.
2016/09/01 22:01:25 - Named cluster: horton - User Home Directory Access: INFO Successfully read directory contents.
2016/09/01 22:01:25 - Named cluster: horton - Successfully read the contents of directory.
2016/09/01 22:01:25 - Named cluster: horton - Root Directory Access: INFO Successfully read directory contents.
2016/09/01 22:01:25 - Named cluster: horton - Successfully read the contents of hdfs://192.168.35.129:8020/app-logs, hdfs://192.168.35.129:8020/apps, hdfs://192.168.35.129:8020/hdp, hdfs://192.168.35.129:8020/mapred, hdfs://192.168.35.129:8020/mr-history, hdfs://192.168.35.129:8020/system, hdfs://192.168.35.129:8020/tmp, hdfs://192.168.35.129:8020/user directory.
2016/09/01 22:01:25 - Named cluster: horton - Verify User Home Permissions: INFO User has write and delete permissions for their home directory.
2016/09/01 22:01:25 - Named cluster: horton - User has write and delete permissions for hdfs://192.168.35.129:8020/user/Cmanohar/pentaho-shim-test-file.test directory.
2016/09/01 22:01:25 - Named cluster: horton - Cluster Test: Map Reduce
2016/09/01 22:01:25 - Named cluster: horton - Ping Job Tracker / Resource Manager: FATAL Unable to connect to the host.
2016/09/01 22:01:25 - Named cluster: horton - Unable to connect to 192.168.35.129 at port: 8032.
2016/09/01 22:01:25 - Named cluster: horton - Cluster Test: Oozie
2016/09/01 22:01:25 - Named cluster: horton - Oozie Host Connection: INFO Successfully connected to host.
2016/09/01 22:01:25 - Named cluster: horton - Successfully connected to 192.168.35.129 at port 8080.
2016/09/01 22:01:25 - Named cluster: horton - Cluster Test: Zookeeper
2016/09/01 22:01:25 - Named cluster: horton - Zookeeper Ensemble Connection: WARNING Unable to connect to the host.
2016/09/01 22:01:25 - Named cluster: horton - Unable to connect to 192.168.35.129 at port: 2181.
--------------------------------------------------------
Name:  Hadoop Connection error.jpg
Views: 232
Size:  11.0 KB