Why does a single structured query run multiple SQL queries per batch?

不羁岁月 提交于 2020-08-02 06:33:21

问题


Why does the following structured query run multiple SQL queries as can be seen in web UI's SQL tab?

import org.apache.spark.sql.streaming.{OutputMode, Trigger}
import scala.concurrent.duration._
val rates = spark.
  readStream.
  format("rate").
  option("numPartitions", 1).
  load.
  writeStream.
  format("console").
  option("truncate", false).
  option("numRows", 10).
  trigger(Trigger.ProcessingTime(10.seconds)).
  queryName("rate-console").
  start

来源:https://stackoverflow.com/questions/46162143/why-does-a-single-structured-query-run-multiple-sql-queries-per-batch

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!