Business-Intelligence

Microsoft Fabric Real Time Intelligence - Mind the Gap !

Microsoft Fabric Real Time Intelligence - Mind the Gap !

I work with a lot of clients that are creating analytic systems. They all collect large numbers of data points and analyze them. Most do a fairly good job with it.

One area that many also handle well is detecting anomalies i.e. data that is out of the ordinary.

But another area that I see very few handling well, is the data that is missing, rather than just the data that is present. There’s a huge difference between data that arrived, and is odd, and data that just didn’t arrive at all.

2024-11-18

Book Review: Microsoft Power BI Performance Best Practices

Book Review: Microsoft Power BI Performance Best Practices

Another book that my friends at PackT sent me for review recently was Microsoft Power BI Performance Best Practices by Thomas LeBlanc and Bhavik Merchant.

Over the years, I’ve come across Thomas many times but haven’t had the chance to spend time with him, unlike Bhavik who worked here in Australia quite a bit. They are a good combination to write this book.

Content - Downloads

I like the fact that samples of everything discussed in the book are available. I also like the idea that if you bought the printed book, that you can download a PDF as well.

2024-10-01

Book Review: Deciphering Data Architectures

Book Review: Deciphering Data Architectures

I had some clear time this morning so I read a recent book called Deciphering Data Architectures (Choosing Between a Modern Data Warehouse, Data Fabric, Data Lakehouse, and Data Mesh) by James Serra.

Price

One comment I need to make is that for some reason, the O’Reilly titles seem to have become more expensive lately, and their freight options are expensive too. It was the same for this book. It was $112 AUD landed at my place. That’s so much more than any similar book that I’ve read lately, and this is not a large book.

2024-08-15

Fabric Down Under show 8 with guest Heidi Hasting now available!

Fabric Down Under show 8 with guest Heidi Hasting now available!

Another Fabric Down Under podcast is out the door. This time it was with a another fellow “Down Under” guest Heidi Hasting from Adelaide.

Heidi Hasting is a Business Intelligence professional and former software developer with over ten years experience in Microsoft products.  She’s an MVP, MCT and holder of many certifications along with being an ALM/DLM enthusiast and Azure DevOps fan and co-founder and organiser of the Adelaide Power BI User Group.

2024-07-24

SSIS: Reading pipe delimited text and selecting particular output columns

SSIS: Reading pipe delimited text and selecting particular output columns

There was a question on the Q&A forums today, asking how to read data using SSIS, when it’s in this format:

|Col1| |Col2|Col3|Col|
|101| |A|21|DC|

One of the concerns was that there was a leading pipe. This is not a problem. When you have data like that, and you set | as the delimiter, because there are 6 delimiters, then there are 7 columns output. These are the values:

Column 1: blank string Column 2: 101 Column 3: blank string Column 4: A Column 5: 21 Column 6: DC Column 7: blank string

2024-07-19

Book Review: Azure Data Factory Cookbook (Second Edition)

Book Review: Azure Data Factory Cookbook (Second Edition)

A few weeks ago, I received another book from our friends at PackT. It was the second edition of Azure Data Factory Cookbook by Dmitry Foshin, Dmitry Anoshin, Tonya Chernyshova, and Xenia Ireton.

I liked the earlier version of this book, and I was pleased to see substantial work had gone into this second edition.

It’s interesting that the book doesn’t stick directly to Azure Data Factory (ADF) but also branches into topics on Azure Synapse Analytics, Microsoft Fabric, and Databricks.

2024-06-14

Book Review: Data Cleaning with Power BI

Book Review: Data Cleaning with Power BI

I was excited to see Gus Frazer’s new book on Data Cleaning with Power BI. Our friends at PackT sent a copy for me to take a look at.

Gus has a background with both Power BI and Tableau, and it’s always interesting to see a mix of perspectives in any book. In this book, he shows a variety of data cleaning/cleansing tasks, then how to do many of them with M in Power Query. And you can tell Gus has a teaching background. because chapters have review questions. The book could well support a course.

2024-06-10

Book Review: Extending Power BI with Python and R

Book Review: Extending Power BI with Python and R

I’ve seen a few books lately from the PackT people. The latest was the second edition of Extending Power BI with Python and R by Luca Zavarella: Perform advanced analysis using the power of analytical languages.

Author

Luca Zavarella

The author is Luca Zavarella. I’ve been working with Power BI since before it was released, and ever since I’ve seen discussions around using R (initially) and Python (later), Luca has been one of those people that everyone listens to.

2024-05-06

SQL Down Under show 85 with guest Bob Duffy discussing building data warehouses is now published

SQL Down Under show 85 with guest Bob Duffy discussing building data warehouses is now published

And another new SQL Down Under show is published!

Once again, I had the great pleasure yesterday to record a podcast with one of my UK based friends Bob Duffy.

Bob is a Principal Data Architect at Prodata’s SQL Centre of Excellence in Dublin, Ireland. He helps enterprise customers build large scale enterprise data warehouses in Azure, typically integrating ERP and financial systems.

Bob is a long-term Data Platform MVP, a Microsoft Certified Architect, Master, and Analysis Services Maestro. He holds a number of Azure role-based certifications. Bob also specialises in performance tuning, architecture, load testing, DevOps, Software engineering, MQ architecture, semantic modelling and meta data driven design on the MS platform.

2024-03-07