Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
Luuk_J
New Contributor III

Spark connector import error in notebook

Hi all,

 

Just getting started with the Fabric notebooks and trying to load a view from the Lakehouse SQL endpoint as per: https://learn.microsoft.com/en-us/fabric/data-engineering/spark-data-warehouse-connector

 

However, during the required imports I get the following error:

Luuk_J_1-1723812875314.png

 

The first line succeeds, second line throws the error. I'm (as per documentation) using Spark (Scala) in that cell.
Any suggestions how to fix this?

Thanks in advance!

Luuk

 

1 ACCEPTED SOLUTION
Anonymous
Not applicable

Hi @Luuk_J 

 

You are not importing the correct module. The correct one is as below.

vjingzhanmsft_0-1724032119742.png

Important

Run these import statements at the beginning of your notebook or before you start using the connector:

import com.microsoft.spark.fabric.tds.implicits.read.FabricSparkTDSImplicits._

import org.apache.spark.sql.functions._

 

Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

View solution in original post

2 REPLIES 2
Anonymous
Not applicable

Hi @Luuk_J 

 

You are not importing the correct module. The correct one is as below.

vjingzhanmsft_0-1724032119742.png

Important

Run these import statements at the beginning of your notebook or before you start using the connector:

import com.microsoft.spark.fabric.tds.implicits.read.FabricSparkTDSImplicits._

import org.apache.spark.sql.functions._

 

Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

Luuk_J
New Contributor III

Ah my bad, must have mixed up several things in the process. Thanks for the quick reply, the import is working correctly now!

Helpful resources

Announcements
Users online (2,085)