Skip to main content
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
KimTutein
Contributor

Skip line count missing in copy activity

Hi Community

I am looking into moving some datapipelines from Synapse into Fabric. We have few that just read delimited text files (non compressed). However it seems like the copy activity no longer support โ€œSkip line countโ€.

Is this really correct or is there something I am missing? I know I could wrangle data in a notebook but if I just want to read a delemitted textfile and replace a table that should not be necessary?

 

Regards

Kim Tutein

 

Screendump: 

KimTutein_0-1740654483105.png

 

1 ACCEPTED SOLUTION
v-csrikanth
Honored Contributor

Hi @KimTutein 
Thanks for reaching out to Microsoft Fabric Community Form.


Microsoft Fabric's Data Factory currently lacks support for the "skip line count" option when reading delimited text files in copy activity. In Azure Synapse, users had the ability to skip header rows or unwanted lines, but this functionality is not yet available in Fabric.

If you need to skip lines, you can use PySpark in a notebook to filter out specific rows during data ingestion.

To request this feature, you can submit an idea to the Microsoft Fabric Ideas forum. Microsoft reviews user requests, and popular features may be added in future updates.

When submitting, explain how this feature helped in Synapse and why it is needed in Fabric.


If the above information is helpful, please give us Kudos and mark the response as Accepted as solution.

Best Regards,

Community Support Team _ C Srikanth.

  

View solution in original post

2 REPLIES 2
v-csrikanth
Honored Contributor

Hi @KimTutein 
Thanks for reaching out to Microsoft Fabric Community Form.


Microsoft Fabric's Data Factory currently lacks support for the "skip line count" option when reading delimited text files in copy activity. In Azure Synapse, users had the ability to skip header rows or unwanted lines, but this functionality is not yet available in Fabric.

If you need to skip lines, you can use PySpark in a notebook to filter out specific rows during data ingestion.

To request this feature, you can submit an idea to the Microsoft Fabric Ideas forum. Microsoft reviews user requests, and popular features may be added in future updates.

When submitting, explain how this feature helped in Synapse and why it is needed in Fabric.


If the above information is helpful, please give us Kudos and mark the response as Accepted as solution.

Best Regards,

Community Support Team _ C Srikanth.

  

KimTutein
Contributor

Hi @v-csrikanth 

Thank you for your answer. I feared it was simply not implemented. But yes I am aware that I may do it in a notebook. As I need other wrangling of this data I will opt for the notebook.

Helpful resources

Announcements
Users online (27)