At Tuesday 6th of June 2023, I’m giving an online version of my session “Analyzing Azure Cosmos DB Data with Azure Synapse Link” (which I presented at Techorama). It’s a YouTube live stream for the Azure Cosmos DB global user group (and also Microsoft Reactor). The event starts at 1PM ET, which is 10AM PT, […]
Tag: azure
Reading AFAS REST API Data with Azure Logic Apps
Recently I had to read some REST API data using an Azure Logic App. The data itself comes from AFAS, a Dutch SaaS ERP company. In general, the process is mostly the same as reading the data with Azure Data Factory (check out this blog post to learn more): There’s a minor difference in how […]
Why Managed Identities are Awesome
For the first workdays of this new year, I had the pleasurable task of resetting a bunch of passwords. The passwords belong to Azure AD users, service principals, SQL Server users etc. and all of these are tied into the ETL process of a data warehouse. Some are used to connect to source data, others […]
Allow a user to only trigger pipelines in Azure Data Factory
Typically you have a bunch of pipelines that are started by one or more triggers. Sometimes, a pipeline needs to be manually triggered. For example, when the finance department is closing the fiscal year, they probably want to run the ETL pipeline a couple of times on-demand, to make sure their latest changes are reflected […]
Logic App errors out when using variables in a SharePoint Action
I have a Logic App that reads out a SharePoint library and stores all the documents found into Azure Blob Storage (ADF only supports Lists). I was trying to make this Logic App “generic”, meaning I could change the source folder and the destination container by using variables. That way, I have one single Logic […]
Speaking at Data Community Austria Day 2023
Let me start by wishing everyone the best for the year 2023! We’re going to kick off the new year with a virtual conference: the Data Community Austria Day 2023. I’m going to present the session Migrate your SSIS skills to ADF. You can find the schedule with all the abstracts on Sessionize. Hope to […]
How to Specify the Format of the Request Body of an Azure Function
This is a bit of a niche blog post, because you don’t actually need this to make your Azure Function work :). When you create a new HTTP-triggered Azure Function (using C# code) in Visual Studio, you’ll get the following boilerplate code: This code reads the body of the HTTP request (called req) and tries […]
User Group Meeting – Migrate your SSIS skills to ADF & More
This Monday (the 5th of December 2022), my employer AE hosts a user group meeting for dataminds. There will be two sessions: It’ll be a very interesting evening, and catering is provided. For registration and practical details, check out the dataminds website. I’ve uploaded my slidedeck to Github.
Read data from Azure Synapse Serverless SQL Pools with Azure Data Factory
We have some data we can query using the serverless SQL pools in Azure Synapse Analytics. For this blog post, I’m querying data that is stored in Azure Cosmos DB. Read the blog post How to Store Normalized SQL Server Data into Azure Cosmos DB to learn more about how that data got there. Suppose […]