Azure-Data-Factory-Adf

I recently recorded a podcast with Kamil Nowinsky. Kamil is well-known for creating some tools that make it easy to publish individual Azure Data Factory pipelines. It’s a far better method that the standard ARM (Azure Resource Manager) template deployment that’s provided by Microsoft. However, if you use this method (and I recommend you do), you’ll be publishing pipelines separate to the linked services that your datasets connect to. One mistake I’ve seen a few clients making lately, is that when they created the linked services in different environments, they did so with slightly different names.

2021-01-27

I love working with Azure Data Factory (ADF). There are times though, when I’m stuck wondering what’s going on, and it takes me a moment to discover it. One that had me puzzled recently was a Copy activity that just wouldn’t seem to start. The pipeline had started ok. Previous activities in the pipeline had run just fine. But when it got to the Copy activity, it said “Queued” and just kept saying that seemingly endlessly.

2021-01-06

I work with a lot of technology on a daily basis, much of it amazing. But I still get excited when relatively small enhancements are made, and they make my life or development much better. Timezone support in schedule triggers in Azure Data Factory is one of those changes. Schedule Triggers In Data Factory, the most common type of trigger that we use is a schedule trigger. It’s used to run a pipeline at a specific time or series of times.

2020-11-04

I’ve been working a lot with ADF (Azure Data Factory) again lately. If you’ve started to work with ADF and aren’t using Git in conjunction with it, you need to change that now. ADF objects are also represented as JSON objects and lend themselves nicely to being stored in Git. Another key advantage is that if you don’t have Git connected, when you’re working with ADF, you don’t have a Save button.

2020-02-21