This is part 3 of a series on working with change data capture (CDC) in Azure SQL Database. This part discusses how to enable it and how to use it.
To show how this works, I have created an Azure SQL Database called CDCTest. I created it as a DTU-based database with a service level objective (SLO) of S3. I’ll discuss more about the licensing implications of CDC in part 4.
2023-06-02
I’ve mentioned in a previous post how important I think Microsoft Fabric is going to be.
So, in addition to our existing SQL Down Under, and Cosmos Down Under podcasts, we have a brand new podcast called Fabric Down Under.
In the preview for Microsoft Fabric, one of the key participants from the product group has been Pawel Potasinski. I’ve known Pawel for many years and he’s been the driving force behind many important things. It was great to see him driving community around Microsoft Fabric in preview.
2023-05-24
Microsoft has had a strong lead in BI and analytics for a long time now. The introduction of the tabular data models in 2012 was a watershed moment.
Today, they have announced a private preview of Microsoft Fabric. It’s a bigger deal than the tabular model was, and will set the direction of BI tooling for a long time to come.
The opposition was already struggling to keep up, and in fact, hadn’t managed to do so. Microsoft Fabric will up the ante much, much higher than where we already were.
2023-05-24
I recently noticed a blog post from Jay Gordon that was calling out interesting content from Blaize Stewart on antipatterns for development with Azure Cosmos DB.
I thought this would be a perfect topic for one of our Cosmos Down Under podcasts and Blaize agreed to take part.
So much content talks about what to do with a product, and even though everyone knows there are things you shouldn’t do, very little content talks about these antipatterns. It was great to speak to Blaize about it, and to get his updated thoughts.
2023-05-17
I was recently doing work for a client where I needed to replace some Python code that was being used to upload a file attachment to a REST based service using a POST command. I was trying to do it using a Web Activity in Azure Data Factory. What was surprising was how little information I could find on how to do that.
While I can’t post all the code, I did want to post the core parts here in case it helps others, and for my own future reference. The basic steps involve:
2023-04-29
We have so many great tech friends in Poland. I was pleased to see they are running the MS Tech Summit, and pleased to be speaking at it.
Looks like a great set of sessions : https://mstechsummit.pl/en/ They tell me there are more than 100 sessions spread over 8 tracks.
Not in Poland? Not a problem. It’s running in-person and online, and with video on demand.
The early bird discount is still available but about to end.
2023-04-28
This one had me stumped lately.
I had an variable in ADF where the value contained carriage returns. I needed to remove them.
I guessed that would be easy:
@replace(variables(‘fileContent’), ‘\r’, ‘’)
But no matter what variation of this I tried, it wouldn’t remove them.
Thanks to the genius of fellow MVP Simon Sabin, the answer was:
@replace(variables(‘fileContent’),base64ToString(‘DQ==’),’’)
Note: if you need a line feed (LF) it’s base64ToString(‘Cg==’) and a carriage return / line feed pair (CRLF), is base64ToString(‘DQo=’).
2023-04-24
I was working with a client who has having trouble debugging an ADF pipeline, related to an ODBC linked service not working as expected.
The user had configured the connection string property of an ODBC connection this way:
The Test Connection for that worked fine, but when you click Apply, it fails with an Internal Server Error. Specifically, the error was:
2023-04-24
I was able to record another new Cosmos Down Under podcast today. My guest was Microsoft Senior Program Manager Rodrigo Souza.
In the show, we discussed the Change Data Capture feed for the Analytical store in Azure Cosmos DB. This is a powerful new capability and worth learning about.
I hope you enjoy it. You’ll find it, along with all Cosmos Down Under podcasts at:
2023-04-12
Over the last year, I’ve come to know Alex Kolokolov more, through involvement with his data visualization challenges. I was really pleased to see he’d written his first book Make Your Data Speak (Creating Actionable Data through Excel For Non-Technical Professionals).
I really liked the conversational style of the book. It’s all structured around an approach of “Let’s see how this happens by example”. The tone was really refreshing and should be good to hold people’s interest.
2023-03-12
