I am using the python notebook in ms fabric for some data transformations and trying to write a df to a delta table. I am expecting the following code to create a new table using deltalake library:
write_deltalake(
my_table_url,
new_df, mode 'overwrite',
schema_mode 'merge',
engine 'rust',
storage_options storage_options
)
However, I receive the following error and I couldn't find how to pass the TimestampWithoutTimezone
feature:
CommitFailedError: Writer features must be specified for writerversion >= 7, please specify: TimestampWithoutTimezone
Thanks in advance!