how to create empty data frame in scala
To create an empty DataFrame in Scala, you can use the createDataFrame
method from the SparkSession
class and pass an empty Seq
or List
as the data parameter. Here's an example:
import org.apache.spark.sql.{SparkSession, DataFrame}
val spark = SparkSession.builder()
.appName("Empty DataFrame Example")
.master("local")
.getOrCreate()
val emptyData = Seq.empty[(String, Int)]
val emptyDF: DataFrame = spark.createDataFrame(emptyData)
emptyDF.show()
This code snippet creates an empty DataFrame by passing an empty Seq
of tuples to the createDataFrame
method. The emptyDF
variable represents the resulting empty DataFrame. Finally, the show
method is called to display the empty DataFrame.
Note that you need to have Apache Spark set up in your Scala environment to use the SparkSession
class and create DataFrames.