This is the final blog post of this series on how to extract data from the Exact Online REST API with Azure Data Factory. I’ve you followed along with the previous posts, you’ve seen how you can request new refresh/access tokens from the API, how you can extract data from an endpoint for multiple divisions […]
Tag: syndicated
Azure Data Factory and the Exact Online REST API – Dealing with Pagination
Some endpoints don’t have that much data, both others certainly will, for example financial transactions. The REST API limits the number of records it returns, and for most endpoints this is 60 records. After the first 60 records, you get a link at the bottom of the response that points to the next 60 records. […]
Azure Data Factory and the Exact Online REST API – Retrieving Data from an Endpoint
Finally we’ve come to the core of this blog post series: extracting data from a REST API endpoint. Just to recap, you need the following: an access token that is currently valid. See this blog post. a list of divisions. See the previous blog post. As an example, we’re going to read from the Projects […]
Azure Data Factory and the Exact Online REST API – Retrieving the Divisions
In many ERP software you have the concept of “companies” or “divisions”, a way of logically dividing resources and assets. For example, if you have a company and a sister-company, you can create two divisions to keep everything separate. When you read data from an Exact Online API endpoint, you need to specify for which […]
Azure Data Factory and the Exact Online REST API – Getting a new access token from ADF
Before we create pipelines to fetch data from the REST API, we need to create a helper pipeline that will fetch a new access token. This pipeline has the following format: Get the last known refresh token from the database (or whatever storage you use). You need to have manually retrieved the first pair of […]
Azure Data Factory and the Exact Online REST API – Fetching your first refresh/access tokens
To get data out of the REST API of Exact Online, we first need to authenticate ourselves. With APIs, typically tokens are used: a long string of symbols that will serve as a secret. You pass a token to an API, which will check if the token is valid and if it grants you access. […]
Azure Data Factory and the Exact Online REST API – Introduction
I’m going to do a small blog post series on how to extract data from a REST API using Azure Data Factory. I’m going to use the Exact Online REST API, because it has a series of challenges: a complicated process to get your first access token endpoints with more data will use pagination a […]
Speaking about Snowflake at Techorama 2021
I’m delighted to announce I’m selected to give an introduction to Snowflake on Azure at the virtual Techorama event. You can find more info about the session here. The agenda of the event looks very promising. There are many great sessions related to the Microsoft Data Platform, but the other categories are great as well. […]
Book review: Calling Bullshit – The Art of Skepticism in a Data-Driven World
I recently finished the book Calling Bullshit – The Art of Skepticism in a Data-Driven World by Carl T. Bergstrom & Jevin D. West. I found it a very entertaining read, and especially useful in this day and age of social media, fake news and deep fakes. Calling out bullshit has been necessary for a […]
#TSQL2sday 136 – Your Favorite Data Type
It’s T-SQL Tuesday time again, and this month’s honor to host the blog party goes to Brent Ozar. The topic is data types: Mad about money? Feverish about float? Tell us what you use your favorite data type for, and what people need to know before they get started using it. Data types have so many interesting […]