using parallel's parLapply: unable to access variables within parallel code

后端 未结 3 1112
无人及你
无人及你 2020-12-02 13:14

I recently got a computer with several cores and am learning to use parallel computing. I\'m fairly proficient with lapply and was told parLapply

3条回答
  •  伪装坚强ぢ
    2020-12-02 13:44

    An alternate method provided by Martin Morgan would work here as well.

    This method supplies the objects to each node in the cluster directly in parLapply call with no need to use cluster export:

    library(parallel)
    text.var <- rep("I like cake and ice cream so much!", 20)
    ntv <- length(text.var)
    gc.rate <- 10
    
    pos <-  function(i) {
        paste(sapply(strsplit(tolower(i), " "), nchar), collapse=" | ")
    }
    
    cl <- makeCluster(mc <- getOption("cl.cores", 4))
    parLapply(cl, seq_len(ntv), function(i, pos, text.var, ntv, gc.rate) {
            x <- pos(text.var[i])
            if (i%%gc.rate==0) gc()
            return(x)
        }, pos, text.var, ntv, gc.rate
    )
    

提交回复
热议问题