How to create DataFrame from Scala's List of Iterables?

Question

I have the following Scala value:

val values: List[Iterable[Any]] = Traces().evaluate(features).toList

and I want to convert it to a DataFr

Answer 1

In Spark 2 we can use DataSet by just converting list to DS by toDS API

val ds = list.flatMap(_.split(",")).toDS() // Records split by comma 

or

val ds = list.toDS()

This more convenient than rdd or df