Categories: Fabric

Change Notebook Spark Session Time-Out in Microsoft Fabric

You might know the feeling: you’re writing code in a Notebook in Microsoft Fabric and suddenly you have to leave your workstation for a while. Someone ran the doorbell (you’re working from home and you get some parcels delivered), or you took a coffee break with some colleagues. When you return to your notebook, the Spark session has timed out and when you run a cell, you have to wait for the damn thing to restart again. The agony, waiting for 2-3 minutes for the session to start, and only after that the actual code can start running.

To be honest, session startup time has drastically improved in Fabric, it isn’t as worse as it once was in Azure Data Factory (you know, within mapping data flows). Anyway, if this happens quite a lot to you, you hate waiting and you have CUs to spare (you’re either on the Fabric trial capacity or you have the luck working for a company wanting to pay for a reserved capacity), you can change the timeout of your Spark session. In the bottom left corner, you can click on the session status to get more information about the current session:

In the pop-up, there’s an option to reset the timeout to x amount of minutes or hours.

Take your pick in how long you want an uninterrupted session, and hit apply. The session timeout will reset itself with the new value and you’re good to go!


------------------------------------------------
Do you like this blog post? You can thank me by buying me a beer 🙂
Koen Verbeeck

Koen Verbeeck is a Microsoft Business Intelligence consultant at AE, helping clients to get insight in their data. Koen has a comprehensive knowledge of the SQL Server BI stack, with a particular love for Integration Services. He's also a speaker at various conferences.

Recent Posts

Webinar – Microsoft Fabric for Dummies

On Wednesday May 15th 2024 I will give a free webinar on MSSQLTips.com about Microsoft…

2 days ago

Get row counts of all tables in a Microsoft Fabric warehouse

I loaded some built-in sample data from Wide World Importers into a Fabric warehouse. You…

6 days ago

dataMinds Saturday 2024 – Session Materials

It was great being at dataMinds Saturday 2024 this past weekend. A great crowd of…

1 week ago

Check your regions people

Today I was having a nice discussion with some colleagues about Fabric and pricing/licensing came…

3 weeks ago

Book Review – Deciphering Data Architectures

I recently purchased and read the book Deciphering Data Architectures - Choosing Between a Modern…

4 weeks ago

Fabulous Stuff in Fabric – Part 5: Folders in Workspaces

A while ago I had a little blog post series about cool stuff in Snowflake. I’m…

1 month ago