pyspark.sql.DataFrame.write

property DataFrame.write

Interface for saving the content of the non-streaming DataFrame out into external storage.

New in version 1.4.0.

Changed in version 3.4.0: Supports Spark Connect.

Returns

DataFrameWriter

Examples

>>> df = spark.createDataFrame([(2, "Alice"), (5, "Bob")], schema=["age", "name"])
>>> type(df.write)
<class '...readwriter.DataFrameWriter'>

Write the DataFrame as a table.

>>> _ = spark.sql("DROP TABLE IF EXISTS tab2")
>>> df.write.saveAsTable("tab2")
>>> _ = spark.sql("DROP TABLE tab2")

previous

pyspark.sql.DataFrame.withWatermark

next

pyspark.sql.DataFrame.writeStream