Skip to main content
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
fabric_1
New Contributor II

CommitFailedError:Writer features must be specified for writerversion >= 7, please specify: Timest**

HI,

 

I am using the below code to write data to append data to a deltatable using a fabric notebook using pure python,

write_deltalake(table_path, data=df, mode = 'append', schema_mode='merge', engine = 'rust', storage_options=storage_options)

I have a column that is in timestamp format and I have already removed the timezone from it.

df['_createdAt'] = pd.to_datetime(df['_createdAt']).dt.tz_localize(None)

However, I am facing the below issue and I am unable to append the data sucessfully.

CommitFailedError: Writer features must be specified for writerversion >= 7, please specify:TimestampWithoutTimezone

 

How do I specify writer features.

 

Kindly help!

1 ACCEPTED SOLUTION
v-prasare
Honored Contributor II

Hi @fabric_1 , 

In this scenario i suggest you to raise a support ticket here. so, that they can assit you in addressing the issue you are facing. please follow below link on how to raise a support ticket:

How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

 

 

 

Thanks,

Prashanth Are

MS Fabric community support

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

View solution in original post

4 REPLIES 4
v-prasare
Honored Contributor II

Hi @fabric_1,

 

Delta Lake protocol Writer Version 7+ introduces new features that require explicit declaration of feature usage. One such feature is TimestampWithoutTimezone.

Even though you've localized the timestamp to remove timezone, Delta Lake still expects you to declare that you're using timezone-less timestamps explicitly in the write_features parameter.

 

If you are writing timestamp columns frequently and want to future-proof your pipeline:

Always set write_features = ["TimestampWithoutTimezone"] when using writer version โ‰ฅ 7.

 

 

 

Thanks,

Prashanth Are

 

fabric_1
New Contributor II

Thanks @v-prasare, How do we actually specify it in the notebook?

 

I tried write_features = ["TimestampWithoutTimezone"], this still doesn't seem to work.

v-prasare
Honored Contributor II

Hi @fabric_1 , 

In this scenario i suggest you to raise a support ticket here. so, that they can assit you in addressing the issue you are facing. please follow below link on how to raise a support ticket:

How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

 

 

 

Thanks,

Prashanth Are

MS Fabric community support

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

v-prasare
Honored Contributor II

Hi, We are following up once again regarding your query. Could you please confirm if the issue has been resolved through the support ticket with Microsoft?

If the issue has been resolved, we kindly request you to share the resolution or key insights here to help others in the community. If we donโ€™t hear back, weโ€™ll go ahead and close this thread.

Should you need further assistance in the future, we encourage you to reach out via the Microsoft Fabric Community Forum. Weโ€™ll be happy to help.

 

Thank you for your understanding and participation.

Helpful resources

Announcements
Users online (27)