Invalid column name, synapse pipeline

[Rbakker888]

Operation on target ForEachCopyData failed: Activity failed because an inner activity failed; Inner activity name: Execute CopyData, Error: Operation on target CopyData failed: ErrorCode=ParquetInvalidColumnName,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The column name is invalid. Column name cannot contain these character:[,;{}()\n\t=],Source=Microsoft.DataTransfer.Common,'

After trying to add a new table to my synapse database from my main SQL database I keep getting this error when I want to try to copy the dimensions.

Checking my data tho, there is nothing like those characters in any of the columns of this new table.

The first picture I give here is how my csv file looks that decides which tables get extracted, the 2nd picture is how my table looks in the sql database.

[Rbakker888]

I believe I found the issue myself, after doing some research it turns out parquet cant have whitepaces in column names. Currently waiting on the dbowner to change the names, will mark as solution if it works after that.

[Srisakthi]

Hi @Rbakker888 ,

You are right. Fabric doesnt allow spaces in column names. You can create table in Fabric with proper naming and data type and then use that table in your pipeline instead of changing the source.

Regards,

Srisakthi

[v-nmadadi-msft · Accepted solution]

Hi @Rbakker888  ,
Thanks for reaching out to the Microsoft fabric community forum.

In addition to whitespaces, column names should not include special characters like
[,;{}()\n\t=] as well as these are invalid.
Please modify and check if you are able to bypass the error now.

Source: Troubleshoot the Parquet format connector - Microsoft Fabric | Microsoft Learn

If this post helps, then please consider Accepting as solution to help the other members find it more quickly and consider giving a KUDOS. Feel free to reach out if you need further assistance.
Thank you

[v-nmadadi-msft]

Hi @Rbakker888 

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

[v-nmadadi-msft]

Hi @Rbakker888 

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If our responses has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

[v-nmadadi-msft]

Hi @Rbakker888 

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the community members for the issue worked. If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.

Thanks and regards