I’m using a clustered columnstore index (CCI) on one of my fact tables at a client. The row size is between 8 and 9 million rows and I was wondering how I could load data efficiently in this CCI using SSIS. I stumbled upon this MSDN blog post: SQL Server 2016 SSIS Data Flow Buffer […]
Category: SSIS
SSIS Trick: Adding Multiple Packages to a Project
A little SSIS trick today. Sometimes you start a new Integration Services project and you want to add some existing packages to this project. So you can right-click the SSIS Packages node and choose Add Existing Package. In the dialog, you choose the File System. All you now have to do is choose the package […]
Reblog: SSIS Performance Testing
I had to do some performance testing for an MSSQLTips article and I thought I’d share the framework I used in a blog post. First of all we have to log start and end dates of the package to a table so we can easily calculate the duration a package took to finish. This can probably […]
Reblog: Building the Script Component
SQLKover update: For some reason, this was my most popular blog post on the old LTD site. Over 110,000 views. People must be building them script components. The problem From time to time I have to script out some logic using a Script Component in a SSIS package. Business as usual for most developers, but since […]
Book review – Extending SSIS with .NET Scripting
Recently I got my hands on a copy of Extending SSIS with .NET Scripting, written by SQL Server MVP Joost van Rossum (blog | twitter). My .NET scripting knowledge could use an update, so I decided to read the whole book and provide you with a full review. About the author I’ve known Joost van Rossum for […]
Webinar – SSIS Best Practices and Tuning Tips
I’ll be giving an SSIS webinar for MSSQLTips.com on Tuesday 15th September 2015. The title is SQL Server Integration Services Best Practices and Tuning Tips and its abstract goes like this: Did you ever inherited a slow running un-maintainable mess of an SSIS package? Or do you want to knock up your SSIS developing skills […]
SSIS – Unexpected Termination
I was toying around with the new SQL Server 2016 CTP release and I wanted to run a few SSIS packages to test out the new logging levels. However, everytime I ran a package in the SSIS catalog, it ended with the dreaded “unexpected termination” message. In such a case, nothing is logged to the catalog, so […]
Reblog: Force installation of 64-bit ACE OLE DB provider
Anyone working with SSIS and Excel probably had the following issue: you are creating an SSIS package using an Excel file in BIDS/SSDT – which is a 32-bit application – and when you try to run the package, it crashes. This is easily fixed by setting the project property Run64BitRuntime to False. The package now […]
Reblog: Slow source? Make your data flow buffers smaller!
Whoa whoah. Aren’t you supposed to increase your data flow buffer size in order to speed up your packages? If you have enough memory and you can process more rows at the same time because your buffer is larger, that’s what we want, right? Yes, this is confirmed by the old blog post Adjust buffer […]
Scripts and SSDT-BI 2013
Recently I tried to open a script component in SSDT-BI 2013. I was developing for SSIS 2014, so this means using Visual Studio 2013 (I explain in this blog post how I set this up using Visual Studio online). However, I got a message saying there was a compatibility issue with Visual Studio 2012. (this […]