A new feature has been launched that allows you to have more granular control over the execution costs of your pipelines. By enabling the feature, you have a cost overview per pipeline in your cost analysis in the Azure portal and in your billing report. This is great news if you want to figure out […]
Tag: azure
Speaking Engagements for Fall 2022
The summer holiday is almost over, and this means conference season will be back in full swing again. I’ll be speaking at a couple of events in the second half of this year: Data Bash. A new free virtual conference focusing on the German-speaking nations in Europe. And on data of course. There are sessions […]
SharePoint List only returns 100 items in Azure Logic App
I was reading a SharePoint List using the “Get Items” activity in an Azure Logic App. I explain how you can create such a Logic App in the blog post Reading a SharePoint List with Azure Logic App. It all worked fine for a while, but recently the list grew larger than 100 items. Suddenly, […]
How you can save up to 80% on Azure Data Factory pricing
… with this one weird little trick 🙂 Sorry for the clickbait, but you can actually save a lot on ADF pricing if you design your pipelines carefully. And as we will see, don’t do everything in ADF. Before we proceed further, I advise to watch this short YouTube video by Cathrine Wilhelmsen on ADF […]
How to Deploy an Azure Function with PowerShell using Azure Devops
In the blog post Azure Function with PowerShell and the Power BI REST API I explained how you could create an Azure Function using the PowerShell scripting language. This Function connected with the Power BI REST API and retrieved the last refresh status of a dataset. Developing the Function is one thing, deploying it is […]
Azure Function with PowerShell and the Power BI REST API
In this blog post I’m going to show you how you can create an Azure Function that will interact with the Power BI REST API. I choose PowerShell as the programming language because in my opinion it was a bit easier to authenticate with the Power BI service. For the development environment, I’m using Visual […]
How to Deploy Azure Logic Apps with ARM and Azure Devops
It’s easy to duplicate an Azure Logic App in a resource group, but unfortunately you cannot duplicate a Logic App between environments (you might try to copy paste the JSON though). So unless you want to hand craft every Logic App yourself on each of your environments, you need a way to automatically deploy your […]
Logic Apps and Source Control (with PowerShell)
At a data warehouse project I’m using a couple of Logic Apps to do some lightweight data movements. For example: reading a SharePoint list and dumping the contents into a SQL Server table. Or reading CSV files from a OneDrive directory and putting them in Blob storage. Some of those things can be done in […]
Error – Reference to external ‘master.dacpac’ could not be resolved when deploying dacpac in Azure Devops
I have a database project in Visual Studio. Inside the database, I use a couple of system views to fetch some metadata about tables. To make the project build successfully, you need to add a reference to the master database in the project. I created a build pipeline in Azure Devops, which builds the Visual […]
Book Review – Pro Serverless Data Handling with Microsoft Azure
Yet another book review! I just finished the book Pro Serverless Data Handling with Microsoft Azure: Architecting ETL and Data-Driven Applications in the Cloud (what a title :), written by German MVPs (and metalheads) Benjamin Kettner and Frank Geisler. The book handles the topic of “serverless” computing in the Microsoft Data Platform, where serverless is […]