Skip to main content
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
Jy
New Contributor

Is LakeHouse required to run SparkSQL queries?

I have a notebook running with Spark SQL queries. I do not have a Lakehouse attached. Seeing the error "Spark SQL queries are only possible in the context of a lakehouse. Please attach a lakehouse to proceed" when trying to run the Spark SQL query. 

 

Are there options to run this without attaching the Lakehouse?

1 ACCEPTED SOLUTION
frithjof_v
Honored Contributor

Hi @Jy 

 

In my experience, you can use Spark SQL without attaching a Lakehouse to the Notebook.

 

I did it by using the abfss path to create a dataframe of my data.

 

Then I used this dataframe as the source to create a temporary view.

 

Then I could use the temporary view for doing Spark SQL.

 

https://community.fabric.microsoft.com/t5/Data-Engineering/Mounting-NB-on-the-fly/m-p/4057425/highli...

View solution in original post

2 REPLIES 2
Anonymous
Not applicable

Hi @Jy ,

 

Running Spark SQL queries in Fabric does require attaching lakehouse.

 

Unfortunately, there is no other option to run Spark SQL queries in Fabric Lakehouse notebooks without attaching a lakehouse.Lakehouse provides the necessary context and storage for executing these queries.

 

If you want to run Spark SQL queries, attach a Lakehouse.

 

Best Regards,
Yang
Community Support Team

 

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

frithjof_v
Honored Contributor

Hi @Jy 

 

In my experience, you can use Spark SQL without attaching a Lakehouse to the Notebook.

 

I did it by using the abfss path to create a dataframe of my data.

 

Then I used this dataframe as the source to create a temporary view.

 

Then I could use the temporary view for doing Spark SQL.

 

https://community.fabric.microsoft.com/t5/Data-Engineering/Mounting-NB-on-the-fly/m-p/4057425/highli...

Helpful resources

Announcements
Top Solution Authors
Users online (3,584)