I’m going to do a small blog post series on how to extract data from a REST API using Azure Data Factory. I’m going to use the Exact Online REST API, because it has a series of challenges: a complicated process to get your first access token endpoints with more data will use pagination a […]
Tag: azure
Migrating SSIS to Azure – an Overview
For quite some time now, there’s been the possibility to lift-and-shift your on-premises SSIS project to Azure Data Factory. There, they run in an Integration Runtime, a cluster of virtual machines that will execute your SSIS packages. In the beginning, you only had the option to use the project deployment model and host your SSIS […]
Speaking at DataMinds Connect 2020
I’m delighted to announce I’ll be speaking again at DataMinds Connect this year, one of the greatest and best Microsoft Data Platform conferences on the European mainland. Due to the pandemic, this year edition is virtual, but this also means: more sessions! And a deep-dive track! And the event itself is free! The agenda is […]
Switching between different Azure Data Factory environments
When working with Azure Data Factory, it’s possible you have multiple ADF environments. For example, you can have one for dev, one for test and one for production. Unfortunately, the functionality to switch between them is a bit hidden in the user interface. One might assume you could find it in the breadcrumbs in the […]
Reading a SharePoint List with Azure Logic App
Sometimes in life you have to do things you really don’t like to do. Such as extracting data from a SharePoint List. Usually I use SSIS and the OData source component for this task, as described in one of my most popular articles ever: Reading SharePoint Lists with Integration Services 2017 (I’m not kidding). However, […]
Cloudbrew 2019 – Slides
Cloudbrew 2019 is over and it was a great event. Great speakers and a big audience. Even in my session there were a lot of attendees, which I found a bit surprising, because at general tech events there tend to be less people in the data tracks. Not this time however, I nicely filled room […]
Speaking Engagements End 2019
Currently I have two conferences in the pipeline. The first is our local DataMinds Connect, the biggest Microsoft data platform conference of the BeNeLux. I’ll be giving a session about the Snowflake cloud data warehouse on Azure, which is pretty much the same one as the one I gave for DataGrillen. The agenda of DataMinds […]
The Azure-SSIS IR Startup Time
UPDATE: here’s an official blog post going in more technical detail on how they achieved the improvements in startup time If you want to run SSIS packages in Azure Data Factory, you need the Azure SSIS Integration Runtime (quite the mouthful), which is basically a cluster of virtual machines handling the packages like an SSIS […]
Migrating SSIS to Azure – Slidedeck (Techorama 2019)
Techorama 2019 is over and it was a blast, as usual. Neatly organised, great speakers and fantastic content. I delivered a session on Migrating SSIS to Azure (Data Factory). You can find the slidedeck on SlideShare: Migrating SSIS to the cloud from KoenVerbeeck
Speaking at Techorama 2019
I’m delighted to announce I’ll be giving a talk at Techorama 2019. It’s one of the best events I’ve ever been to and I’ll be in the good company of Grant Fritchey, Jen Stirrup, Pinal Dave and Brent Ozar (+ many others)! That’s right, the line-up for the data platform is amazing, so be sure […]