PDA

View Full Version : Connecting to Remote Cassandra Node (errors)



tysonjh
04-04-2012, 11:19 AM
Hello All,

I'm trying to get a feel for Kettle and Spoon but haven't had any success connecting to my Cassandra cluster. I'm experiencing a couple problems in fact, the first is with the "Show Schema" button from the "Cassandra input" screen. With the following data filled in,

Cassandra host: xxx.xxx.xxx.xxx
Cassandra port: 9160
Keyspace: apachelogs
CQL: SELECT * FROM logindex;

*note: xxx.xxx.xxx.xxx was replaced to hide my real IP =)

Show Schema produces an error "Column names are neither UTF-8 or ASCII!" - am I to assume that these are the only supported column names? Regardless, the column names are ASCII.

So continuing on, when I try to "Preview" the data in this step, 0 rows are returned and in the logs an error log is printed out (see below). I have verified my local connection to the cluster by using "cassandra-cli -h xxx.xxx.xxx.xxx". Are there some configuration steps I am missing?

Thanks!
-Tyson


012/04/04 11:09:13 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@5bd31f85 - Unable to connect to retrieve column meta data for 'flumeindex' at this stage.
2012/04/04 11:09:14 - Transformation 1 - Dispatching started for transformation [Transformation 1]
2012/04/04 11:09:14 - Cassandra Input.0 - Connecting to Cassandra node at 'xxx.xxx.xxx.xxx:9160' using keyspace 'apachelogs'...
2012/04/04 11:09:14 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@5bd31f85 - Unable to connect to retrieve column meta data for 'logindex' at this stage.
2012/04/04 11:09:14 - Cassandra Input.0 - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Unexpected error
2012/04/04 11:09:14 - Cassandra Input.0 - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : org.pentaho.di.core.exception.KettleException:
2012/04/04 11:09:14 - Cassandra Input.0 - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : It doesn't look like the query will produce any output fields!
2012/04/04 11:09:14 - Cassandra Input.0 - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) :
2012/04/04 11:09:14 - Cassandra Input.0 - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.trans.steps.cassandrainput.CassandraInput.processRow(CassandraInput.java:144)
2012/04/04 11:09:14 - Cassandra Input.0 - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at org.pentaho.di.trans.step.RunThread.run(RunThread.java:50)
2012/04/04 11:09:14 - Cassandra Input.0 - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : at java.lang.Thread.run(Thread.java:722)
2012/04/04 11:09:14 - Cassandra Input.0 - Closing connection...
2012/04/04 11:09:14 - Cassandra Input.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=1)
2012/04/04 11:09:14 - Spoon - The transformation has finished!!
2012/04/04 11:09:14 - Transformation 1 - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Errors detected!
2012/04/04 11:09:15 - Transformation 1 - ERROR (version 4.3.0, build 16295 from 2012-01-27 15.53.26 by tomcat) : Errors detected!
2012/04/04 11:09:15 - Transformation 1 - Transformation 1
2012/04/04 11:09:15 - Transformation 1 - Transformation 1
2012/04/04 11:09:15 - Cassandra Input.0 - Closing connection...

Mark
04-04-2012, 10:07 PM
Hi,

What version of Cassandra are you running? If you do a "show schema" from the cassandra-cli what does it show for the "comparator" entry?

Cheers,
Mark.

oriZim
04-18-2012, 03:01 AM
Hey,

facing the same issue. tried it with various column families and all are failing.

* Using Cassandra 1.0.
* Comparator type has few different types for different column families that had been tried: BytesType, IntegerType

another thing, when i press the 'Show Schema' on the declararion screen (cassandra connection and CQL query), i get the following error:
Column names are neither UTF-8 or ASCII

thanks i advance.

Mark
04-18-2012, 04:38 AM
Yes, at present Cassandra input is limited to textual column names. This made the most sense for static column families before the option to output key, value tuples for all columns in a row as separate Kettle rows was added (thus supporting dynamic column families). For dynamic column families, the textual column name constraint needs to be relaxed and we'll be addressing that soon.

Cheers,
Mark.

chitrahce2511
07-13-2015, 07:45 AM
Hello All,

I'm trying to read data from cassandra.

Steps:
File -> New -> Transformation -> Big Data -> Cassandra Input
Cassandra host: 10.123.34.1
Cassandra port: 9160
Keyspace: testkeyspace
CQL: SELECT * FROM testcolumnfamily;
Use CQL Version 3 is ticked

Clicked on "Preview", getting below error:

2015/07/13 15:06:31 - Spoon - Transformation opened.
2015/07/13 15:06:31 - Spoon - Launching transformation [populate_cassandra_page_successions]...
2015/07/13 15:06:31 - Spoon - Started the transformation execution.
2015/07/13 15:06:31 - Spoon - The transformation has finished!!
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : An error occurred while getting the schema information::
null
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : InvalidRequestException(why:Undefined name populate_io_cache_on_flush in selection clause)
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result$execute_cql3_query_resultStandardScheme.read(Cassandra.java:49032)
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result$execute_cql3_query_resultStandardScheme.read(Cassandra.java:49009)
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:48924)


2015/07/13 17:11:41 - Cassandra Input.0 - Connecting to Cassandra node at 10.123.34.1 : 9160 using keyspace testkeyspace ...
2015/07/13 17:11:41 - Cassandra Input.0 - Using connection options: cqlVersion=3.0.1
2015/07/13 17:11:41 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@5a708775 - Unable to connect to retrieve column meta data for testcolumnfamily at this stage
2015/07/13 17:11:41 - Cassandra Input.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Unexpected error
2015/07/13 17:11:41 - Cassandra Input.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2015/07/13 17:11:41 - Cassandra Input.0 - It doesnt look like the query will produce any output fields!
2015/07/13 17:11:41 - Cassandra Input.0 -
2015/07/13 17:11:41 - Cassandra Input.0 - at org.pentaho.di.trans.steps.cassandrainput.CassandraInput.processRow(CassandraInput.java:200)
2015/07/13 17:11:41 - Cassandra Input.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2015/07/13 17:11:41 - Cassandra Input.0 - at java.lang.Thread.run(Unknown Source)
2015/07/13 17:11:41 - Cassandra Input.0 - Closing connection ...
2015/07/13 17:11:41 - Cassandra Input.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=1)
2015/07/13 17:11:41 - D:\Pentaho_Testing\read_write_cassandra\read_from_cassandra.ktr : read_from_cassandra - Transformation detected one or more steps with errors.
2015/07/13 17:11:41 - dummy.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2015/07/13 17:11:41 - D:\Pentaho_Testing\read_write_cassandra\read_from_cassandra.ktr : read_from_cassandra - Transformation is killing the other steps!

villo
07-28-2015, 09:22 AM
I'm actually having the exact same issue, running on Cassandra 2.2.0. Has anybody got a solution?
Thank you, cheers


Hello All,

I'm trying to read data from cassandra.

Steps:
File -> New -> Transformation -> Big Data -> Cassandra Input
Cassandra host: 10.123.34.1
Cassandra port: 9160
Keyspace: testkeyspace
CQL: SELECT * FROM testcolumnfamily;
Use CQL Version 3 is ticked

Clicked on "Preview", getting below error:

2015/07/13 15:06:31 - Spoon - Transformation opened.
2015/07/13 15:06:31 - Spoon - Launching transformation [populate_cassandra_page_successions]...
2015/07/13 15:06:31 - Spoon - Started the transformation execution.
2015/07/13 15:06:31 - Spoon - The transformation has finished!!
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : An error occurred while getting the schema information::
null
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : InvalidRequestException(why:Undefined name populate_io_cache_on_flush in selection clause)
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result$execute_cql3_query_resultStandardScheme.read(Cassandra.java:49032)
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result$execute_cql3_query_resultStandardScheme.read(Cassandra.java:49009)
2015/07/13 15:30:57 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@6ac4812f - at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:48924)


2015/07/13 17:11:41 - Cassandra Input.0 - Connecting to Cassandra node at 10.123.34.1 : 9160 using keyspace testkeyspace ...
2015/07/13 17:11:41 - Cassandra Input.0 - Using connection options: cqlVersion=3.0.1
2015/07/13 17:11:41 - org.pentaho.di.trans.steps.cassandrainput.CassandraInputMeta@5a708775 - Unable to connect to retrieve column meta data for testcolumnfamily at this stage
2015/07/13 17:11:41 - Cassandra Input.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Unexpected error
2015/07/13 17:11:41 - Cassandra Input.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2015/07/13 17:11:41 - Cassandra Input.0 - It doesnt look like the query will produce any output fields!
2015/07/13 17:11:41 - Cassandra Input.0 -
2015/07/13 17:11:41 - Cassandra Input.0 - at org.pentaho.di.trans.steps.cassandrainput.CassandraInput.processRow(CassandraInput.java:200)
2015/07/13 17:11:41 - Cassandra Input.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2015/07/13 17:11:41 - Cassandra Input.0 - at java.lang.Thread.run(Unknown Source)
2015/07/13 17:11:41 - Cassandra Input.0 - Closing connection ...
2015/07/13 17:11:41 - Cassandra Input.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=1)
2015/07/13 17:11:41 - D:\Pentaho_Testing\read_write_cassandra\read_from_cassandra.ktr : read_from_cassandra - Transformation detected one or more steps with errors.
2015/07/13 17:11:41 - dummy.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2015/07/13 17:11:41 - D:\Pentaho_Testing\read_write_cassandra\read_from_cassandra.ktr : read_from_cassandra - Transformation is killing the other steps!