Data Factory - append fields to JSON sink

问题

I am using the copy activity to copy/transform a JSON source dataset into JSON sink dataset. Need to append a few audit fields to the output - such as transform date using @utcnow expression function.

How can this be accomplished?

回答1:

It looks like the databricks activity handles this functionality pretty well.

df_new = df.select("table.field1","table.field2","table.field3").withColumn("TransferDate", current_timestamp())

来源：https://stackoverflow.com/questions/51883988/data-factory-append-fields-to-json-sink