This is part 3 of a series on working with change data capture (CDC) in Azure SQL Database. This part discusses how to enable it and how to use it.
To show how this works, I have created an Azure SQL Database called CDCTest. I created it as a DTU-based database with a service level objective (SLO) of S3. I’ll discuss more about the licensing implications of CDC in part 4.
2023-06-02
We have so many great tech friends in Poland. I was pleased to see they are running the MS Tech Summit, and pleased to be speaking at it.
Looks like a great set of sessions : https://mstechsummit.pl/en/ They tell me there are more than 100 sessions spread over 8 tracks.
Not in Poland? Not a problem. It’s running in-person and online, and with video on demand.
The early bird discount is still available but about to end.
2023-04-28
In the part 1 of this series, I discussed the positioning of Change Data Capture. In part 2, I want to cover how it works.
There are many ways that you can output details of changes that occur in data within SQL Server. Many of those methods require actions to occur at the time the data change is made. This can be problematic.
The first problem with this, is the performance impact on the application that’s making the change. If I update a row in a table and there is part of the process that writes details of that change to some type of audit or tracking log, I’ve now increased the work that needs to happen in the context of the application that’s making the change. Generally what this means, is that I’ve slowed the application down by at least doubling the work that needs to be performed. That might not be well-received.
2023-03-06
I often need to capture the changes from one database into another. The most common reason is that I’m wanting to bring changes from a transactional system across into a data warehouse that’s part of a BI setup.
So which technology is best to use for this?
That’s not a trivial question to answer but here are some thoughts:
Unfortunately, this one’s not available for Azure SQL DB as yet. Azure SQL DB can be a subscriber in Transactional Replication. We often use it this way. If we have an on-premises SQL Server, one of our favourite ways to get data into the cloud is by using Transactional Replication. (If you need to get your head around Replication with SQL Server, just head to our course here).
2023-02-26
Just a heads-up that v23 of SDU Tools went out to SDU Insiders yesterday.
You can find details about SDU Tools here: https://sdutools.sqldownunder.com
In v23, we’ve added or enhanced the following:
You can see a short video on the new Excel conversion functions here:
2023-01-19
I recorded the first of a series of podcasts for the SQL Server 2022 timeframe recently. Once again, it was great to chat with another old friend Davide Mauri. Davide is a Principal Product Manager for Azure SQL Database.
Note that the topic I chose for today was the new sp_invoke_external_rest_endpoint system stored procedure, and it’s currently only available for Azure SQL Database but I expect it will get ported to other flavours of SQL Server over time. Davide has been deeply involved with the development of this procedure.
2022-12-16
I’m always excited when I can get involved in conferences with our Polish friends.
Coming up very soon is the Data Science Summit 2022: https://dssconf.pl/en/
For this summit, I’ll be presenting a quick (around 40 minutes) session highlighting what’s changed in T-SQL for SQL Server 2022. I’m always so glad to see T-SQL enhancements in SQL Server and SQL Server 2022 has more than what we’ve seen in other recent versions. There are a number of very important enhancements that will take a little while to get our heads around, on the best way to use them.
2022-11-06
I’ve just finished publishing another show for the Cosmos Down Under Podcast. This time the guest is Charles Feddersen.
Charles (and ex-Melbourne local) is working for Microsoft in the Azure Cosmos DB team. His current focus is the PostgreSQL API that Azure Cosmos DB supports.
In this show, Charles discusses the state of the PostgreSQL market, how it’s implemented in the Azure Cosmos DB for PostgreSQL API, how that compares to Microsoft’s Flexible Server offering for PostgreSQL, distributed tables, scaling databases, and so much more.
2022-11-04
I have a varied client base. Many of my customers are traditional larger financial organizations. But I also work with start-ups and software houses. (Microsoft calls these ISVs - Independent Software Vendors).
Most software houses don’t want to sell software any more. Instead, they want to repackage their solutions as services i.e. they want to offer Software as a Service. (SaaS)
Converting an application to a service is not easy. Even Microsoft had false starts with moving their on-premises applications to cloud-based offerings.
2022-10-03
I’ve just finished publishing another show for the Cosmos Down Under Podcast. This time the guest is Will Velida.
Will is an Engineer for Microsoft working in the Fast Track for Azure team. His focus is on application development and modernization. He is passionate about developers from all walks of life build great things using Azure. Prior to joining Microsoft, he has worked as a software engineer in the financial and agricultural sectors. He was also a Microsoft MVP in the Data Platform category, focusing on Azure Cosmos DB.
2022-08-31
