Linting is a process where a code analyzer is run to find programmatic errors, bugs, “stylistic constructs” or anti-patterns. For example, in Python there are specific modules that help you with linting when the code is build. If the code is not indented correctly (or whatever rule your code has to obey in Python), the […]
Category: Azure
Migrating SSIS to Azure – an Overview
For quite some time now, there’s been the possibility to lift-and-shift your on-premises SSIS project to Azure Data Factory. There, they run in an Integration Runtime, a cluster of virtual machines that will execute your SSIS packages. In the beginning, you only had the option to use the project deployment model and host your SSIS […]
Switching between different Azure Data Factory environments
When working with Azure Data Factory, it’s possible you have multiple ADF environments. For example, you can have one for dev, one for test and one for production. Unfortunately, the functionality to switch between them is a bit hidden in the user interface. One might assume you could find it in the breadcrumbs in the […]
Reading a SharePoint List with Azure Logic App
Sometimes in life you have to do things you really don’t like to do. Such as extracting data from a SharePoint List. Usually I use SSIS and the OData source component for this task, as described in one of my most popular articles ever: Reading SharePoint Lists with Integration Services 2017 (I’m not kidding). However, […]
Cloudbrew 2019 – Slides
Cloudbrew 2019 is over and it was a great event. Great speakers and a big audience. Even in my session there were a lot of attendees, which I found a bit surprising, because at general tech events there tend to be less people in the data tracks. Not this time however, I nicely filled room […]
Migrating SSIS to Azure – Slidedeck (Techorama 2019)
Techorama 2019 is over and it was a blast, as usual. Neatly organised, great speakers and fantastic content. I delivered a session on Migrating SSIS to Azure (Data Factory). You can find the slidedeck on SlideShare: Migrating SSIS to the cloud from KoenVerbeeck
Issue while using SQLCompare against Azure SQL DB
I’ve encountered an issue while trying to compare a local SQL Server database against an Azure SQL DB using Redgate SQLCompare. When trying to specify my credentials, I got the following error: “Unable to load adalsql.ddl”. Following that link actually leads you to a helpful page, where you can download the Active Directory Authentication Library […]
Two Small Tips for Working with Azure
Very quick blog post about two tips for working with Azure (hence the title of course). I recently started up a project where the data warehouse needed to be fully in the cloud. This was an Azure SQL Database, not Azure Data Warehouse. The size of the DWH was just not big enough (although Microsoft […]