我已经检查了Spark 3.3.0 &它正确地截断了最后几秒。检查下面。

scala> spark
.sql("select date_format(current_timestamp, 'yyyy-MM-dd hh:mm:ss') as ts ")
.show(false)
+-------------------+
|ts                 |
+-------------------+
|2023-10-17 04:46:52|
+-------------------+

from datetime import datetime

data1 = [   ["1"],
            ["2"],
        ]

df1Columns = ["id"]
df1 = sqlContext.createDataFrame(data=data1, schema = df1Columns)
current_datetime = datetime.now()
new_df = df1.withColumn("date", F.date_format(F.lit(current_datetime), 'yyyy-MM-dd HH:mm:ss'))
new_df.show(truncate=False)

输出量：

+---+-------------------+
|id |date               |
+---+-------------------+
|1  |2023-10-16 23:57:01|
|2  |2023-10-16 23:57:01|
+---+-------------------+