Categories: Fabric

Fabulous Stuff in Fabric – Part 2: Deactivating Activities in Pipelines

A while ago I had a little blog post series about cool stuff in Snowflake. I’m doing a similar series now, but this time for Microsoft Fabric. I’m not going to cover the basic of Fabric, hundreds of bloggers have already done that. I’m going to cover little bits & pieces that I find interesting, that are similar to Snowflake features or something that is an improvement over the “regular” SQL Server or related products.

In this blog post I’m highlighting the fact we can now deactivate activities in a pipeline, which is extremely useful when you want to debug a pipeline but don’t want to run the whole damn thing. Just right-click the activity and choose deactiviate.

When deactivated, the activity will turn grey and it will be skipped when the pipeline runs (in debug mode or in an actual run).

Validation will be skipped as well, which is handy when you haven’t completed the configuration of an activity yet, but you want to run the rest of the pipeline. Keep in mind that if other activities depend on the output of your disabled activity – for example a For Each loop activity looping over the output of a Lookup activity – that they might fail. You can try to mitigate this by using variables with default values.

This functionality is not only present but also in Azure Data Factory and Synapse Pipelines. This blog post is actually a bit bittersweet, because this is really basic functionality that should have been there from the start. We were able to disable tasks in SSIS since … checks notes … 2005. You know, when the product launched. But I’m glad it’s finally in the product and that Fabric keeps improving over time.

Related:
Fabulous Stuff in Fabric – Part 1: Cloning Tables


------------------------------------------------
Do you like this blog post? You can thank me by buying me a beer 🙂
Koen Verbeeck

Koen Verbeeck is a Microsoft Business Intelligence consultant at AE, helping clients to get insight in their data. Koen has a comprehensive knowledge of the SQL Server BI stack, with a particular love for Integration Services. He's also a speaker at various conferences.

Recent Posts

Free webinar – Tackling the Gaps and Islands Problem with T-SQL Window Functions

I'm hosting a free webinar at MSSQLTips.com at the 19th of December 2024, 6PM UTC.…

5 days ago

dataMinds Connect 2024 – Session Materials

The slides and scripts for my session "Tackling the Gaps & Islands Problem with T-SQL…

4 weeks ago

Connect to Power BI as a Guest User in another Tenant

Sometimes your Microsoft Entra ID account (formerly known as Azure Active Directory) is added as…

2 months ago

How to use a Script Activity in ADF as a Lookup

In Azure Data Factory (ADF, but also Synapse Pipelines and Fabric Pipelines), you have a…

4 months ago

Database Build Error – Incorrect syntax near DISTINCT

I wrote a piece of SQL that had some new T-SQL syntax in it: IS…

4 months ago

Speaking at dataMinds Connect 2024

I'm very excited to announce I've been selected as a speaker for dataMinds Connect 2024,…

5 months ago