Skip to main content
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
aarongiust
New Contributor

Dataflow retains case sensitivity but not anywhere else

I created a Lakehouse table using a dataflow and it retains the camel casing I used for the table and column names but if I try to do that myself in a notebook using a CREATE TABLE statement, it just makes it all lowercase. Why is that?

1 ACCEPTED SOLUTION
Anonymous
Not applicable

Hi @aarongiust , @govindarajan_d 

Spark is not case sensitive by default.

 

There is a way to handle this issue by adding spark config , using a SparkSession object named spark:

spark.conf.set('spark.sql.caseSensitive', True)

By default it is False.

Hope this is helpful. Please let me know incase of further queries.

View solution in original post

2 REPLIES 2
govindarajan_d
Contributor III

Hi @aarongiust,

 

I tried it but it creates Sentence case for me:

govindarajan_d_0-1706770024847.png

 

Any other specific config that you are passing?

Anonymous
Not applicable

Hi @aarongiust , @govindarajan_d 

Spark is not case sensitive by default.

 

There is a way to handle this issue by adding spark config , using a SparkSession object named spark:

spark.conf.set('spark.sql.caseSensitive', True)

By default it is False.

Hope this is helpful. Please let me know incase of further queries.

Helpful resources

Announcements
Users online (25)