How to pass a list of paths to spark.read.load?

Question

I can load multiple files at once by passing multiple paths to the load method, e.g.

spark.read
  .format(\"com.databricks.spark.avro\")
  .load         


        

Answer 1

You need not to create list. You can do like below

val df=spark.read.format("com.databricks.spark.avro").option("header","true").load("/data/src/entity1/*")