Cassandra load balancing with an ordered partitioner?

非 Y 不嫁゛ 提交于 2020-01-13 09:25:13

问题


So I see here that Cassandra does not have automatic load balancing, which comes into view when using the ordered partitioner (a certain common range of values of a group of rows would be stored on a relatively few machines which would then serve most of the queries).
What's The Best Practice In Designing A Cassandra Data Model?

I'm still new to Cassandra and how it works. how would one go about avoiding this issue, so that range queries are still possible? I didn't really get the above answers (linked url) idea about appending a hash to keys.


回答1:


As mentioned on the other post, Cassandra 0.5 supports semiautomatic load balancing, where all you have to do is tell a node to loadbalance and it will move to a busier place on the token ring automatically.

This is covered in http://wiki.apache.org/cassandra/Operations




回答2:


I think this issue is best taken up on the cassandra-user mailing list; that is where people are.

Cassandra does not have automatic load balancing yet but it may do so in the not-too-distant future. The 0.5 branch may be capable of this now.

Essentially when you bootstrap a node on an already-running system, it should find a spot in the ring which will load balance best and put itself there. Provided you add nodes one at a time (i.e. wait for one node to finish bootstrapping before adding another), that should work pretty well, provided your key distribution doesn't change too much over time.

However, your keys may change over time (especially if they are time-based) so you might want a workaround.

It depends on what you want to range-scan. If you only need to range scan PART of the key, you could hash the bit that you don't want to range scan, and use that as the first part of the key.

I'll use the term "partition" here to refer to the part of the key you don't want to range scan

function makeWholeKey(partition, key) {
   return concat(make_hash(partition), partition, key);
}

Now if you want to range scan the keys within a given partition, you can range scan between makeWholeKey(p,start) and makeWholeKey(p,end)

But if you want to scan the partitions, you're out of luck.

But you can make your nodes have tokens which are evenly distributed around the range of make_hash() output, and you'll get evenly distributed data (assuming you have ENOUGH partitions that it doesn't all clump up on one or two hash values)




回答3:


Partitioning of data across cluster is controlled by the partitioner parameter in cassandra.yaml:

partitioner: org.apache.cassandra.dht.Murmur3Partitioner

Using Murmur3Partitioner will generate random hashcode for Row Key and perform load balancing.

With Cassandra 2.0, you can store multiple tokens (256) in single server, which will also help in load balancing. It is not good practice to use OrderPreservingPartitioner and is deprecated.



来源:https://stackoverflow.com/questions/1767789/cassandra-load-balancing-with-an-ordered-partitioner

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!