Slower Insert Performance in Couchbase Cluster

橙三吉。 提交于 2019-12-13 02:16:55

问题


I am new to Couchbase. I was in the process of checking raw performance of INSERTs with various Couchbase setups (single node, 2-node, 5-node etc.) I am using VMs on Windows Azure to do my testing since I do not have enough hardware to test it on my servers. I am using the .NET client library provided by Couchbase to write my C# based test application that does record insertion in a loop. Also, I am not using any bulk insert options (if any exist!)

Here are the results of inserts thus far:

  • Time taken for 10 million records on a hardware server - roughly 10 minutes
  • Time taken for 10 million records on a VM server on Azuere - roughly 21 minutes
  • Time taken for 10 million records on a 2-node VM cluster on Azure 63 minutes

So here are my questions:

  • Is visualization causing the insertion to come down to half of a hardware server?
  • Is it normal for a Couchbase 2 node cluster to take 3 times as much compared to a 1 node Couchbase?

I have followed this article to set up Couchbase cluster in Windows Azure: Couchbase on Azure


回答1:


Couchbase usally intensivly uses hard disk and cpu for indexing process. So performance degradation in cloud is normal. You can try to use disks with more IOPS or even SSDs to reduce latency.

While your app generates data it also uses cpu, so couchbase performance (on the same VM) can degrade. For more clear test, I think you should run application on separated (dedicated) VM (i.e. VM3). Also performance differs due to latency between VMs. To reduce it, try to locate VMs in one zone, datacenter. I think if you use separate VM for client difference between 1 and 2 node cluster will not be so huge.

In your case performance on 1 node cluster depends mostly on latency between VM and hard disk attached to this VM. In 2 node cluster performance depends mostly on latence between VM1 and VM2 that can be 2-4 times bigger than latency between VM and hard disk. So performance in your cases will be inversely proportional to latences.

performance_1 ~ 1 / HDD_latency_VM1
performance_2 ~ 1 / (HDD_latency_VM1 + Network_latency_2_VM2 + HDD_latency_VM2)


来源:https://stackoverflow.com/questions/20347016/slower-insert-performance-in-couchbase-cluster

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!