Let me start by wishing everyone the best for the year 2023! We’re going to kick off the new year with a virtual conference: the Data Community Austria Day 2023. I’m going to present the session Migrate your SSIS skills to ADF. You can find the schedule with all the abstracts on Sessionize. Hope to […]
Tag: azure
How to Specify the Format of the Request Body of an Azure Function
This is a bit of a niche blog post, because you don’t actually need this to make your Azure Function work :). When you create a new HTTP-triggered Azure Function (using C# code) in Visual Studio, you’ll get the following boilerplate code: This code reads the body of the HTTP request (called req) and tries […]
User Group Meeting – Migrate your SSIS skills to ADF & More
This Monday (the 5th of December 2022), my employer AE hosts a user group meeting for dataminds. There will be two sessions: It’ll be a very interesting evening, and catering is provided. For registration and practical details, check out the dataminds website. I’ve uploaded my slidedeck to Github.
Read data from Azure Synapse Serverless SQL Pools with Azure Data Factory
We have some data we can query using the serverless SQL pools in Azure Synapse Analytics. For this blog post, I’m querying data that is stored in Azure Cosmos DB. Read the blog post How to Store Normalized SQL Server Data into Azure Cosmos DB to learn more about how that data got there. Suppose […]
How to Store Normalized SQL Server Data into Azure Cosmos DB
Recently I got a hold of my Untappd data. For those who don’t know the app, it’s a rating app for beers. You can check-in a beer each time you drink one (by scanning the barcode for example), and then rate it, assign flavors et cetera. I did a GDPR request to get all my […]
Granular Cost Management for Azure Data Factory
A new feature has been launched that allows you to have more granular control over the execution costs of your pipelines. By enabling the feature, you have a cost overview per pipeline in your cost analysis in the Azure portal and in your billing report. This is great news if you want to figure out […]
Speaking Engagements for Fall 2022
The summer holiday is almost over, and this means conference season will be back in full swing again. I’ll be speaking at a couple of events in the second half of this year: Data Bash. A new free virtual conference focusing on the German-speaking nations in Europe. And on data of course. There are sessions […]
SharePoint List only returns 100 items in Azure Logic App
I was reading a SharePoint List using the “Get Items” activity in an Azure Logic App. I explain how you can create such a Logic App in the blog post Reading a SharePoint List with Azure Logic App. It all worked fine for a while, but recently the list grew larger than 100 items. Suddenly, […]
How you can save up to 80% on Azure Data Factory pricing
… with this one weird little trick 🙂 Sorry for the clickbait, but you can actually save a lot on ADF pricing if you design your pipelines carefully. And as we will see, don’t do everything in ADF. Before we proceed further, I advise to watch this short YouTube video by Cathrine Wilhelmsen on ADF […]
How to Deploy an Azure Function with PowerShell using Azure Devops
In the blog post Azure Function with PowerShell and the Power BI REST API I explained how you could create an Azure Function using the PowerShell scripting language. This Function connected with the Power BI REST API and retrieved the last refresh status of a dataset. Developing the Function is one thing, deploying it is […]