Skip to main content
Under the kover of business intelligence
  • Home
  • Copyright
  • About

Category: Azure Data Factory

Secure Logic Apps with OAuth Authorization

September 17, 2025September 17, 2025 Koen Verbeeck Leave a comment

I’ve used Logic Apps a couple of times over the past years for simple workflows, like sending an email (still not supported in ADF, booooo), reading a SharePoint List or copying some files from A to B (cheaper than the Copy Data Activity in ADF). When you create a Logic App with an HTTP trigger […]

Read More

Parameterize Linked Service in ADF with no Dynamic Content available

June 26, 2025June 26, 2025 Koen Verbeeck Leave a comment

When you create linked services in Azure Data Factory (ADF) or in a Synapse Workspace, you typically want to parameterize certain properties of the connection. When you deploy your artefacts to another environment, you can change the parameter values to switch the connection to the new environment. For example, the server name of the connection […]

Read More

Azure Data Factory Pipeline Debugging Fails with BadRequest

April 4, 2025April 4, 2025 Koen Verbeeck Leave a comment

I recently had a new pipeline fail. It was actually a copy of an old pipeline where I had made some adjustments into as part of a database migration. When triggered during an execution run, it failed saying some expression could not be parsed. When I went into the pipeline and triggered a debug, it […]

Read More

Call a Fabric REST API from Azure Data Factory

April 1, 2025April 1, 2025 Koen Verbeeck 1 Comment

Suppose you want to call a certain Microsoft Fabric REST API endpoint from Azure Data Factory (or Synapse Pipelines). This can be done using a Web Activity, and most Fabric APIs now support service principals or managed identities. Let’s illustrate with an example. I’m going to call the REST API endpoint to create a new […]

Read More

How to use a Script Activity in ADF as a Lookup

June 27, 2024June 27, 2024 Koen Verbeeck 1 Comment

In Azure Data Factory (ADF, but also Synapse Pipelines and Fabric Pipelines), you have a typical scenario where you retrieve some metadata from a database and then loop over the metadata with a ForEach activity. For example, to copy all the table from a source database in a metadata-driven pipeline. The obvious choice would be […]

Read More

Planview Portfolios REST API with ADF – Retrieving Actual Data

May 26, 2024May 26, 2024 Koen Verbeeck Leave a comment

In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios REST API using Azure Data Factory. Any tool that can send HTTPS requests can work with the REST API, but our focus here is ADF (which can also be Synapse Pipelines or Fabric Pipelines). In the […]

Read More

Planview Portfolios REST API with ADF – Fetching the Access Token

May 26, 2024May 26, 2024 Koen Verbeeck Leave a comment

In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios RESET API using Azure Data Factory. Any tool that can send HTTPS requests can work with the REST API, but our focus here is ADF (which can also be Synapse Pipelines or Fabric Pipelines). In the […]

Read More

Planview Portfolios REST API with ADF – The OData Feed

May 26, 2024May 26, 2024 Koen Verbeeck Leave a comment

In the introduction, I explained the setup of the use case and why we need to use the OData feed: to get the list of Project IDs, because the REST API doesn’t have an endpoint for this. Weird, right? In this part of the series, we’ll dive into the Lookup activity, which uses the OData […]

Read More

Extracting Data from the Planview Portfolios REST API using ADF – Introduction

May 26, 2024May 27, 2024 Koen Verbeeck Leave a comment

I have a client using Planview Portfolios to manage their PMO. As part of the data warehouse, we want to extract the project data from the Planview REST API. There are other methods to get data, such as using OData (which is used in the Power BI connector), SOAP Web Services (2005 called) and a […]

Read More

t-sql tuesday long

#TSQL2sday 171 – Describe the Most Recent Issue You Closed

February 13, 2024February 13, 2024 Koen Verbeeck Leave a comment

It’s #TSQL2sday time! This month’s invitation has been sent out by Brent Ozar and he asks us to describe the most recent issue – or the last ticket – we closed. In my case, I actually blogged about it in this blog post: Azure Function App doesn’t retrieve most recent secret value from Azure Key […]

Read More

Posts pagination

1 2 3 Older posts

Feed

RSS

Social

  • Twitter
  • LinkedIn

Former MVP

Former Microsoft Data Platform MVP (2017-2025)

star schema all the things
Get your star schema merchandise

Author of the Year 2014/2020/2023

Support this blog and buy me a beer

Recent Posts

  • dataMinds Connect 2025 – Slides & Scripts
  • Cloud Data Driven User Group 2025 – Slides & Scripts
  • Retro Data 2025 – Slidedeck
  • Secure Logic Apps with OAuth Authorization
  • Free Online Sessions – Building the €100 DWH and Indexing for Dummies

Categories

  • Azure (28)
  • Azure Data Factory (27)
  • Azure Devops (5)
  • Book Review (26)
  • Business Intelligence (29)
  • Events (61)
  • Fabric (19)
  • Power BI (42)
  • Professional Development (9)
  • Snowflake (14)
  • SQL Server (114)
    • MDS (8)
    • SSAS (12)
    • SSIS (46)
    • SSRS (13)
    • TSQL (9)
  • Varia (37)
  • Twitter
  • LinkedIn
  • Home
  • Copyright
  • About
Under the kover of business intelligence All rights reserved. Theme by Colorlib Powered by WordPress