snow

R: set 'Checkpoint' on Worker of Cluster

由 送分小仙女□ 提交于 2019-12-23 16:48:07
问题 I use the following code to ... 1. create a parallel cluster 2. source test.R 3. and do some parallel work with functions defined in 'test.R' library(parallel) cl <- makeCluster(4) clusterEvalQ(cl, source("test.R")) ## do some parallel work stopCluster(cl) Unfortunately I rely on old packages :-( One can make use of past snapshots of the CRAN packages using 'checkpoints' require(checkpoint) checkpoint("2015-02-28") My question is ... how can I make use of the old packages on the Cluster

How to set up cluster slave nodes (on Windows)

由 喜你入骨 提交于 2019-12-19 10:26:42
问题 I need to run thousands* of models on 15 machines (each of 4 cores), all Windows. I started to learn parallel , snow and snowfall packages and read a bunch of intro's, but they mainly focus on the setup of the master. There is only a little information on how to set up the worker (slave) nodes on Windows. The information is often contradictory: some say that SOCK cluster is practically the easiest way to go, others claim that SOCK cluster setup is complicated on Windows (sshd setup) and the

Using Rcpp within parallel code via snow to make a cluster

由 南楼画角 提交于 2019-12-17 02:26:33
问题 I've written a function in Rcpp and compiled it with inline . Now, I want to run it in parallel on different cores, but I'm getting a strange error. Here's a minimal example, where the function funCPP1 can be compiled and runs well by itself, but cannot be called by snow 's clusterCall function. The function runs well as a single process, but gives the following error when ran in parallel: Error in checkForRemoteErrors(lapply(cl, recvResult)) : 2 nodes produced errors; first error: NULL value

Using Rcpp within parallel code via snow to make a cluster

由 穿精又带淫゛_ 提交于 2019-12-13 04:15:53
问题 I've written a function in Rcpp and compiled it with inline . Now, I want to run it in parallel on different cores, but I'm getting a strange error. Here's a minimal example, where the function funCPP1 can be compiled and runs well by itself, but cannot be called by snow 's clusterCall function. The function runs well as a single process, but gives the following error when ran in parallel: Error in checkForRemoteErrors(lapply(cl, recvResult)) : 2 nodes produced errors; first error: NULL value

R + Snow + Fortran + MPI crash

由 梦想的初衷 提交于 2019-12-13 02:14:58
问题 This is a follow-up to my previous question. I created an R package that uses a MPI Fortran module. This is the module: Module Fortranpi USE MPI IMPLICIT NONE contains subroutine dboard(darts, dartsscore) integer, intent(in) :: darts double precision, intent(out) :: dartsscore double precision :: x_coord, y_coord integer :: score, n score = 0 do n = 1, darts call random_number(x_coord) call random_number(y_coord) if ((x_coord**2 + y_coord**2) <= 1.0d0) then score = score + 1 end if end do

makeCluster function in R snow hangs indefinitely

由 一笑奈何 提交于 2019-12-12 07:19:36
问题 I am using makeCluster function from R package snow from Linux machine to start a SOCK cluster on a remote Linux machine. All seems settled for the two machines to communicate succesfully (I am able to estabilish ssh connections between the two). But: makeCluster("192.168.128.24",type="SOCK") does not throw any result, just hangs indefinitely. What am I doing wrong? Thanks a lot 回答1: Unfortunately, there are a lot of things that can go wrong when creating a snow (or parallel) cluster object,

avoid R loop and parallelize with snow

由 女生的网名这么多〃 提交于 2019-12-11 06:12:15
问题 I have a large loop that will take too long (~100 days). I'm hoping to speed it up with the snow library, but I'm not great with apply statements. This is only part of the loop, but if I can figure this part out, the rest should be straightforward. I'm ok with a bunch of apply statements or loops, but one apply statement using a function to get object 'p' would be ideal. Original data dim(m1) == x x # x >>> 0 dim(m2) == y x # y >>> 0, y > x, y > x-10 dim(mout) == x x thresh == x-10 #specific

Results of workers not returned properly - snow - debug

由 百般思念 提交于 2019-12-09 18:36:11
问题 I'm using the snow package in R to execute a function on a SOCK cluster with multiple machines(3) running on Linux OS. I tried to run the code with both parLapply and clusterApply . In case of any error at the worker level, the results of the worker nodes are not returned properly to master making it very hard to debug. I'm currently logging every heartbeat of the worker nodes independently using futile.logger . It seems as if the results are properly computed. But when I tried to print the

圣诞节雪花效果，pc端

由 旧城冷巷雨未停 提交于 2019-12-05 17:04:17
<!doctype html> <html lang="en"> <head> <meta charset="UTF-8"> <title>Document</title> <link rel="stylesheet" type="text/css" href="css/snow.css"> <style type="text/css"> .box{width: 100%; height: 900px; background: #000;} </style> </head> <body> <div class="box"></div> <script type="text/javascript" src="js/jquery.min.js"></script> <script type="text/javascript" src="js/snow.js"></script> </body> </html> snow.css /*雪花飘落*/ .snow-container { position: fixed; top: 0; left: 0; width: 100%; pointer-events: none; z-index: 2000; } .snow-container .snow { position: absolute; background: #fff; -webkit

R: making cluster in doParallel / snowfall hangs

由 感情迁移 提交于 2019-12-05 15:41:01
I've got two servers on a LAN with fresh installs of Centos 6.4 minimal and R 3.0.1. Both computers have doParallel, snow, and snowfall packages installed. The servers can ssh to each other fine. When I attempt to make clusters in either direction, I get a prompt for a password, but after entering the password, it just hangs there indefinately. makePSOCKcluster("192.168.1.1",user="username") How can I troubleshoot this? edit: I also tried calling makePSOCKcluster on the above-mentioned computer with a host that IS capable of being used as a slave (from other computers), but it still hangs. So,
订阅 snow