Better alternative to pmap in Clojure for parallelizing moderately inexpensive functions over big data?

后端 未结 4 626
离开以前
离开以前 2020-12-24 12:17

Using clojure I have a very large amount of data in a sequence and I want to process it in parallel, with a relatively small number of cores (4 to 8).

The ea

4条回答
  •  [愿得一人]
    2020-12-24 12:33

    Sadly not a valid answer yet, but something to watch for in the future is Rich's work with the fork/join library coming in Java 7. If you look at his Par branch on github he's done some work with it, and last I had seen the early returns were amazing.

    Example of Rich trying it out.

    http://paste.lisp.org/display/84027

提交回复
热议问题