cluster-computing

Python “FileExists” error when making directory

由 会有一股神秘感。 提交于 2019-11-27 11:06:43
问题 I have several threads running in parallel from Python on a cluster system. Each python thread outputs to a directory mydir . Each script, before outputting checks if mydir exists and if not creates it: if not os.path.isdir(mydir): os.makedirs(mydir) but this yields the error: os.makedirs(self.log_dir) File "/usr/lib/python2.6/os.py", line 157, in makedirs mkdir(name,mode) OSError: [Errno 17] File exists I suspect it might be due to a race condition, where one job creates the dir before the

What's the difference between Apache's Mesos and Google's Kubernetes

由 时光怂恿深爱的人放手 提交于 2019-11-27 09:55:35
What exactly is the difference between Apache's Mesos and Google's Kubernetes? I understand both are server cluster management software. Can anyone elaborate where the main differences are - when would which framework be preferred? Why would you want to use Kubernetes on top of Mesosphere ? Craig Mcluckie Kubernetes is an open source project that brings 'Google style' cluster management capabilities to the world of virtual machines, or 'on the metal' scenarios. It works very well with modern operating system environments (like CoreOS or Red Hat Atomic) that offer up lightweight computing

Data-driven cluster colour with mapboxgl

由 限于喜欢 提交于 2019-11-27 08:30:11
问题 I am trying to draw circle which colour depends on a "group" attribute in my geojson. I followed a simple example with these colours: map.addSource("data", { type: "geojson", data: url, cluster: true, clusterMaxZoom: 12, // Max zoom to cluster points on clusterRadius: 20 // Radius of each cluster when clustering points (defaults to 50) }); map.addLayer({ 'id': 'population', 'type': 'circle', 'source': 'data', 'paint': { // make circles larger as the user zooms from z12 to z22 'circle-radius':

Parallel R on a Windows cluster

由 ℡╲_俬逩灬. 提交于 2019-11-27 07:44:14
问题 I've got a Windows HPC Server running with some nodes in the backend. I would like to run Parallel R using multiple nodes from the backend. I think Parallel R might be using SNOW on Windows, but not too sure about it. My question is, do I need to install R also on the backend nodes? Say I want to use two nodes, 32 cores per node: cl <- makeCluster(c(rep("COMP01",32),rep("COMP02",32)),type="SOCK") Right now, it just hangs. What else do I need to do? Do the backend nodes need some kind of sshd

Clustered Singleton using Wildfly?

由 半城伤御伤魂 提交于 2019-11-27 06:28:43
问题 I'm trying to create a simple clustered Singleton on Wildfly 8.2. I've configured 2 Wildfly instances, running in a standalone clustered configuration. My app is deployed to both, and I'm able to access it with no problem. My clustered EJB looks like this: @Named @Clustered @Singleton public class PeekPokeEJB implements PeekPoke { /** * Logger for this class */ private static final Logger logger = Logger .getLogger(PeekPokeEJB.class); private static final long serialVersionUID =

How to create new Type in MPI

由 拥有回忆 提交于 2019-11-27 03:05:49
问题 I am new to MPI and I want to create a new datatype for Residence struct . I just want to see if I can create the new type right way. struct Residence { double x; double y; }; My new MPI Type MPI_Datatype createRecType() { // Set-up the arguments for the type constructor MPI_Datatype new_type; int count = 2; int blocklens[] = { 1,1 }; MPI_Aint indices[2]; //indices[0]=0; MPI_Type_extent( MPI_DOUBLE, &indices[0] ); MPI_Type_extent( MPI_DOUBLE, &indices[1] ); MPI_Datatype old_types[] = {MPI

PHP sessions in a load balancing cluster - how?

由 我是研究僧i 提交于 2019-11-27 02:46:10
OK, so I've got this totally rare an unique scenario of a load balanced PHP website. The bummer is - it didn't used to be load balanced. Now we're starting to get issues... Currently the only issue is with PHP sessions. Naturally nobody thought of this issue at first so the PHP session configuration was left at its defaults. Thus both servers have their own little stash of session files, and woe is the user who gets the next request thrown to the other server, because that doesn't have the session he created on the first one. Now, I've been reading PHP manual on how to solve this situation.

Elasticsearch in docker container cluster

由 对着背影说爱祢 提交于 2019-11-27 00:55:59
问题 I want to run 2 instance of ElasticSeach on 2 differents hosts. I have build my own docker image based on Ubuntu 14.04 and the 1.3.2 version of elasticsearch. If I run 2 ES' container on 1 host each instance see the other one and can communicate, but when I run 2 instance of ES on 2 differents host it's didn't work. The 9300 port of the container is bind to the 9300 host's port. My question is : it's possible to create an ES' cluster with my configuration ? Best regards, Lucas Rival 回答1: I

setting up cassandra multi node cluster on a single ubuntu server

由 谁说胖子不能爱 提交于 2019-11-26 23:05:30
问题 I have a Cassandra Service running on my Ubuntu Server with a single node now. I want to make it into a ring cluster with 3 nodes to get a feel of multinode cluster all being on the same server. By following the steps in this link https://www.youtube.com/watch?v=oHMJrhMtv3c, I tried to create a fresh cluster without stopping the already running cassandra service. But it has thrown address Caused by: java.net.BindException: Address already in use. So i tried changing the seeds ip to already

Load Balancing (HAProxy or other) - Sticky Sessions

由 感情迁移 提交于 2019-11-26 22:46:18
问题 I'm working on scaling out my app to multiple servers, and one requirement is that a client is always communicating with the same server (too much live data is used to allow bouncing between servers efficiently). My current setup is a small server cluster (using Linode). I have a frontend node running HAProxy using "balance source" so that an IP is always pointed towards the same node. I'm noticing that "balance source" is not a very even distribution. With my current test setup (2 backend
订阅 cluster-computing