data replication from source upon change

[arkiboys2]

Hello,

I have created data factory pipelines in fabric which ingests data from sql server and lands into fabric warehouse once a day.

How is it possible to ingest the sql server table data only when they change at source?

thank you

[AndyDDC]

Hi @arkiboys2 there is nothing yet that can detect source data changes (e.g. CDC) so you'll need to implement some form of scheduled polling with incremental loading.

We're still waiting to see if any CDC functionality will be added, and also when we can mirror SQL Server data into Fabric itself.

[arkiboys2]

mirroring is available, right?

[AndyDDC · Accepted solution]

It is but only for Azure SQL Database, not SQL Server.  Others supported is CosmosDB, Databricks, Snowflake, 

[arkiboys2]

Does this mean in azure sql server, that if a row in a table is updated or inserted then the same table gets an upsert?

[frithjof_v]

https://blog.fabric.microsoft.com/en-US/blog/mirroring-sql-server-database-to-fabric/