Pig script to read Cassandra table

时间秒杀一切 提交于 2019-12-11 11:06:58

问题


Trying to write a Pig script that will extract data from a Cassandra table. The Pig script looks like this:

REGISTER ./cassandra-all-2.0.8.39.jar
REGISTER ./datastax-agent-4.1.4-standalone.jar
REGISTER ./cassandra-driver-core-2.0.2.1.jar
REGISTER ./apache-cassandra-thrift-2.0.12.jar

A = LOAD 'cql://username:password/mykeyspace/mycolumnfamily' 
    USING org.apache.cassandra.hadoop.pig.CqlStorage() 
    AS (user_id:long, fname:chararray, last_update_date:chararray, lname:chararray); 
DUMP A;

I keep getting following message:

java.lang.NoSuchMethodError: org.apache.cassandra.thrift.ITransportFactory.supportedOptions()Ljava/util/Set

So far I’ve tried following version of ‘cassandra-thrift.jar’: 2.0.8.39, 2.0.12, 2.1.2. None of them has helped.

Note: Following environment variables have been set outside this script:

export PIG_INITIAL_ADDRESS=machine-name
export PIG_RPC_PORT=9160
export PIG_PARTITIONER=org.apache.cassandra.dht.Murmur3Partitioner

Any suggestions?

来源:https://stackoverflow.com/questions/28570006/pig-script-to-read-cassandra-table

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!