Spark - Random Number Generation

后端 未结 4 1664
旧时难觅i
旧时难觅i 2021-01-02 00:01

I have written a method that must consider a random number to simulate a Bernoulli distribution. I am using random.nextDouble to generate a number between 0 and

4条回答
  •  旧时难觅i
    2021-01-02 00:50

    Using Spark Dataset API, perhaps for use in an accumulator:

    df.withColumn("_n", substring(rand(),3,4).cast("bigint"))
    

提交回复
热议问题