A while ago I had a little blog post series about cool stuff in Snowflake. I’m doing a similar series now, but this time for Microsoft Fabric. I’m not going to cover the basics of Fabric, hundreds of bloggers have already done that. I’m going to cover little bits & pieces that I find interesting, that […]
Tag: adf
Session Materials for Cloudbrew & Data Meetup Groningen
I presented “Microsoft Fabric for Dummies” at Cloudbrew and “How I saved 80% on my ADF costs” as a lightning talk at Data Meetup Groningen. Both slidedecks can be found at github.
Fabulous Stuff in Fabric – Part 2: Deactivating Activities in Pipelines
A while ago I had a little blog post series about cool stuff in Snowflake. I’m doing a similar series now, but this time for Microsoft Fabric. I’m not going to cover the basic of Fabric, hundreds of bloggers have already done that. I’m going to cover little bits & pieces that I find interesting, that […]
FDD 2023 – Session Materials
You can find the slides for my session at Future Data Driven summit at GitHub. It was really nice presenting (virtually). If you have any questions, let me know!
Speaking at the Future Data Driven Summit 2023
I’m going to give a lightning talk at the online (free) Future Data Driven Summit. The subject is How I saved 80% on my Azure Data Factory Costs. The abstract: Azure Data Factory (ADF) is the tool in the Azure cloud for creating your data pipelines. It allows you to move and transform data from […]
Reading AFAS REST API Data with Azure Logic Apps
Recently I had to read some REST API data using an Azure Logic App. The data itself comes from AFAS, a Dutch SaaS ERP company. In general, the process is mostly the same as reading the data with Azure Data Factory (check out this blog post to learn more): There’s a minor difference in how […]
Speaking at Data Saturday Rheinland – Migrating SSIS to ADF
I’m pleased to announce that I’ll be talking about how you can migrate your SSIS skills to Azure Data Factory at Data Saturday Rheinland. At the time of writing this post, the schedule isn’t online yet, but I assume it will be up shortly. The abstract for my session: Integration Services is the new Cobol. […]
Build Once – Add Metadata (the importance of metadata-driven frameworks)
When working in business intelligence, data engineering or data in general, there are some “mantras” that are being adopted by the larger community as “best practices”. For example, I shout “STAR SCHEMA ALL THE THINGS” anywhere I can, because a star schema is the most optimal way to design your model in Power BI. We […]
Allow a user to only trigger pipelines in Azure Data Factory
Typically you have a bunch of pipelines that are started by one or more triggers. Sometimes, a pipeline needs to be manually triggered. For example, when the finance department is closing the fiscal year, they probably want to run the ETL pipeline a couple of times on-demand, to make sure their latest changes are reflected […]
Speaking at Data Community Austria Day 2023
Let me start by wishing everyone the best for the year 2023! We’re going to kick off the new year with a virtual conference: the Data Community Austria Day 2023. I’m going to present the session Migrate your SSIS skills to ADF. You can find the schedule with all the abstracts on Sessionize. Hope to […]