It’s #TSQL2sday time! This month’s invitation has been sent out by Brent Ozar and he asks us to describe the most recent issue – or the last ticket – we closed. In my case, I actually blogged about it in this blog post: Azure Function App doesn’t retrieve most recent secret value from Azure Key […]
Tag: adf
Fabulous Stuff in Fabric – Part 4: The Office365 Outlook Activity
A while ago I had a little blog post series about cool stuff in Snowflake. I’m doing a similar series now, but this time for Microsoft Fabric. I’m not going to cover the basics of Fabric, hundreds of bloggers have already done that. I’m going to cover little bits & pieces that I find interesting, that […]
Session Materials for Cloudbrew & Data Meetup Groningen
I presented “Microsoft Fabric for Dummies” at Cloudbrew and “How I saved 80% on my ADF costs” as a lightning talk at Data Meetup Groningen. Both slidedecks can be found at github.
Fabulous Stuff in Fabric – Part 2: Deactivating Activities in Pipelines
A while ago I had a little blog post series about cool stuff in Snowflake. I’m doing a similar series now, but this time for Microsoft Fabric. I’m not going to cover the basic of Fabric, hundreds of bloggers have already done that. I’m going to cover little bits & pieces that I find interesting, that […]
FDD 2023 – Session Materials
You can find the slides for my session at Future Data Driven summit at GitHub. It was really nice presenting (virtually). If you have any questions, let me know!
Speaking at the Future Data Driven Summit 2023
I’m going to give a lightning talk at the online (free) Future Data Driven Summit. The subject is How I saved 80% on my Azure Data Factory Costs. The abstract: Azure Data Factory (ADF) is the tool in the Azure cloud for creating your data pipelines. It allows you to move and transform data from […]
Reading AFAS REST API Data with Azure Logic Apps
Recently I had to read some REST API data using an Azure Logic App. The data itself comes from AFAS, a Dutch SaaS ERP company. In general, the process is mostly the same as reading the data with Azure Data Factory (check out this blog post to learn more): There’s a minor difference in how […]
Speaking at Data Saturday Rheinland – Migrating SSIS to ADF
I’m pleased to announce that I’ll be talking about how you can migrate your SSIS skills to Azure Data Factory at Data Saturday Rheinland. At the time of writing this post, the schedule isn’t online yet, but I assume it will be up shortly. The abstract for my session: Integration Services is the new Cobol. […]
Build Once – Add Metadata (the importance of metadata-driven frameworks)
When working in business intelligence, data engineering or data in general, there are some “mantras” that are being adopted by the larger community as “best practices”. For example, I shout “STAR SCHEMA ALL THE THINGS” anywhere I can, because a star schema is the most optimal way to design your model in Power BI. We […]
Allow a user to only trigger pipelines in Azure Data Factory
Typically you have a bunch of pipelines that are started by one or more triggers. Sometimes, a pipeline needs to be manually triggered. For example, when the finance department is closing the fiscal year, they probably want to run the ETL pipeline a couple of times on-demand, to make sure their latest changes are reflected […]