Skip to main content
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
sdfabric
New Contributor III

Is creation of Generic Dynamic DataFlow Gen2 in fabric possible with Schema Drift like ADF DataFlow?

Is creation of Generic Dynamic DataFlow Gen2 in fabric possible with Schema Drift like ADF DataFlow? 

 

If yes, please let me know how to do it and if not, please tell me the timeline to get this feature.

 

Thanks.

11 REPLIES 11
v-cboorla-msft
Honored Contributor II

Hi @sdfabric 

 

Thanks for using Microsoft Fabric Community.

At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.
Appreciate your patience.

 

Thanks.

Hi @v-cboorla-msft ,

 

Please let me know if you have any update.

v-cboorla-msft
Honored Contributor II

Hi @sdfabric 

 

Got an update from our internal team and they asked a question as follows : "What is schema drift or what is the expected behavior that the user wants?"

 

Thank you.

Hi @sdfabric 

 

We havenโ€™t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.

 

Thanks.

Hi @v-cboorla-msft ,

 

I tried the option you suggested but it is not so generic/dynamic dataflow gen2 implementation in fabric like we experienced in ADF data flow gen1. Will there be any  future plan to accomodate the same ? 

v-cboorla-msft
Honored Contributor II

Hi @sdfabric 

 

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

 

Thank you

Hi @v-cboorla-msft ,

 

Schema Drift means if a new column is added to the Souce side, will it be automatically added to the target ? Also, is it possible to dynamically change the Sources / Targets rather than sticking to static data sources/targets ?

v-cboorla-msft
Honored Contributor II

Hi @sdfabric 

 

Please check the documentation on whatโ€™s available today for Dataflow Gen2 in this regard: Dataflow Gen2 data destinations and managed settings - Microsoft Fabric | Microsoft Learn

Specifically the โ€œschema options on publishโ€.

 

I hope this information helps.

 

Thank you.

Hi @v-cboorla-msft ,

 

Getting "404 - Page not found" error for this page.

v-cboorla-msft
Honored Contributor II

Hi @sdfabric 

 

Sorry for the inconvenience caused, I have updated the link. Please try now.

 

Thank you.

Hi @sdfabric 

 

We havenโ€™t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others .
If you have any question relating to the current thread, please do let us know and we will try out best to help you.
In case if you have any other question on a different issue, we request you to open a new thread.

 

Thanks.

Helpful resources

Announcements
Users online (27)