distributed

Small footprint clock synchronization without NTP

允我心安 提交于 2019-11-30 17:31:36
I'm looking for a simple clock synchronization protocol that would be easy to implement with small footprint and that would work also in the absence of internet connection, so that it could be used e.g. within closed laboratory networks. To be clear, I'm not looking for something that can be used just to order events (like vector clocks), but something that would enable processes on different nodes to synchronize their actions based on local clocks. As far as I understand, this would require a solution that can take clock drift into account. Presence of TCP/IP or similar relatively low-latency

Small footprint clock synchronization without NTP

百般思念 提交于 2019-11-30 16:39:45
问题 I'm looking for a simple clock synchronization protocol that would be easy to implement with small footprint and that would work also in the absence of internet connection, so that it could be used e.g. within closed laboratory networks. To be clear, I'm not looking for something that can be used just to order events (like vector clocks), but something that would enable processes on different nodes to synchronize their actions based on local clocks. As far as I understand, this would require

Distributed Tensorflow: CreateSession still waiting

断了今生、忘了曾经 提交于 2019-11-30 16:20:35
Simple script below is launched with args shown in it's header. It behaves differently, but often one of the workers hangs and prints these "CreateSession still waiting for some other task" messages. Why does a new MonitoredTrainingSession need others? And why don't the others wait for it to start? # #!/bin/bash # python train.py --job master --task 0 & # python train.py --job worker --task 0 & # python train.py --job worker --task 1 & # python train.py --job worker --task 2 & import argparse import tensorflow as tf parser = argparse.ArgumentParser() parser.add_argument('--job', type=str)

Hadoop Web Authentication using Kerberos

此生再无相见时 提交于 2019-11-30 15:23:38
I configured hadoop using kerberos, everything works fine, I can browse hdfs, submit jobs, etc. But failed http web authentication. I use hadoop-0.20.2 in cdh3u2, which supports HTTP SPNEGO. HTTP authentication related configurations in core-site.xml are as follows: <!-- HTTP web-consoles Authentication --> <property> <name>hadoop.http.filter.initializers</name> <value>org.apache.hadoop.security.AuthenticationFilterInitializer</value> </property> <property> <name>hadoop.http.authentication.type</name> <value>kerberos</value> </property> <property> <name>hadoop.http.authentication.token

What are the best practices for a small distributed team which will work on a Drupal project?

心不动则不痛 提交于 2019-11-30 14:00:47
after some research, we opted for working with Drupal on our next project and we are a distributed team. Since Drupal stores (based on what we saw until now) all it's content on a database, how can we, as a distributed team work together on this project? What are the best practices we should take? We thought about using a shared database server for this task, but it whould simply destroy the performance we should need to get this project going. Any suggestions about that? Jeremy's answer (+1) is already quite comprehensive. Some additional more practical-oriented advice follows in no

Using single RMI Registry

泄露秘密 提交于 2019-11-30 13:40:57
I've been using RMI for a project I am currently working on and I want to bind from multiple hosts to a single RMI registry. However when I attempt to do so I get an error saying java.rmi.AccessException: Registry.Registry.bind disallowed; origin / 192.168.0.9 is non-local host I did so googling and it seems that RMI stops remote hosts from binding by default, what I want to know is there some way of overriding or bypassing this? If anyone any suggestions on how to get past this issue they would be highly appreciated, i've tried using different policy files and overriding the security manger

GUI recommandations for eventual consistency?

青春壹個敷衍的年華 提交于 2019-11-30 11:34:29
When using distributed and scalable architecture, eventual consistency is often a requirement. Graphically, how to deal with this eventual consistency? Users are used to click save, and see the result instantaneously... with eventual consistency it's not possible. How to deal with the GUI for such scenarios? Please note the question applies both for desktop applications and web applications. PS: I'm working with the Microsoft platform, but I imagine the question applies to any technology... A Task Based UI fits this model great. You create and execute tasks from the UI. You can also have

Distributed shared memory library for C++?

£可爱£侵袭症+ 提交于 2019-11-30 04:37:27
问题 I am writing a distributed application framework in C++. One of the requirements is the provision of distributed shared memory. Rather than write my own from scratch (and potentially re-invent the wheel), I thought I would see if there were any pre-existing Open source libraries - a quick google search did not yield anything to useful. Does anyone on here have any experience of a good C++ DSM library that they can recommend? Ideally, the library will support MRMW (Multiple readers/multiple

Starting remote processes in a Windows network

六眼飞鱼酱① 提交于 2019-11-30 04:31:47
问题 I have several slave machines and a master machine which together run a distributed application. Processes on each slave machine have to have a GUI and network access (I think it would be called an interactive process then). For ease of use it would be nice if the master machine could start/stop the processes on those slave machines. My first idea was to use WMI and the Win32_Process class to start a remote process but upon further investigation it was reveiled that processes started this way

Distributed cross correlation matrix computation

老子叫甜甜 提交于 2019-11-30 03:38:10
问题 How can I calculate pearson cross correlation matrix of large (>10TB) data set, possibly in distributed manner ? Any efficient distributed algorithm suggestion will be appreciated. update: I read the implementation of apache spark mlib correlation Pearson Computaation: /home/d066537/codespark/spark/mllib/src/main/scala/org/apache/spark/mllib/stat/correlation/Correlation.scala Covariance Computation: /home/d066537/codespark/spark/mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed