I have upload the parquet data format file into databricks file System. Now I want to to store this parquet file data into Delta Table (Delta Format). But unable to do. My code is:
spark.read.option("inferschema",true).option("header",true).csv("/FileStore/tables/ExecutiveSummary.txt").
write.format("delta").mode("overwrite").save("/FileStore/tables/delta_train/")
It show me syntax error. What is the issue in this ?
I am using databricks community edition
CodePudding user response:
You can't simply split code into two lines. Your first line is finishing with . character - it's incorrect in python. You need to use either this variant (with \ as continuation marker, and . put to the write word):
spark.read.option("inferschema",true).option("header",true).csv("/FileStore/tables/ExecutiveSummary.txt") \
.write.format("delta").mode("overwrite").save("/FileStore/tables/delta_train/")
or this variant, with () around your expression, but still you need to put . in correct place:
(spark.read.option("inferschema",true).option("header",true).csv("/FileStore/tables/ExecutiveSummary.txt")
.write.format("delta").mode("overwrite").save("/FileStore/tables/delta_train/"))
