Devops

If you have ever tried to write scripts to configure operating systems, you’d realize just how hard that is to get correct. For example, if you need to ensure that your virtual machine has two network adapters, and they need to have a specific set of IP addresses, how do you do that? [caption id=“attachment_2743” align=“alignnone” width=“461”] Image by Markus Spiske[/caption] The traditional approach for PowerShell (and similar tools) was to try to write a step-by-step script to configure the network adapters the way you want.

2018-02-16

I’ve concluded that many software vendors (particularly large ones) don’t understand how much support users of their software provide to each other, and how critical that support is. The SQL and data communities are a good example of this. When someone has a problem and are wondering how to solve it, they don’t call Microsoft or Google or Oracle (or whichever vendor) first. If they’re lucky, they ask a colleague for help.

2018-02-13

I spend a lot of time in large organizations that have spent an absolute fortune on highly-available systems, yet when those systems fail over (just as they were designed to do), most of the applications in the building break. Why? Because the developers have assumed that nothing ever breaks and have written their code in a far too optimistic manner. Did they do their jobs? No Is it possible for their next layer of code to deal with, say, a server disappearing for a few seconds?

2018-02-09

One key decision that you need to take when you decide to include databases in your DevOps processes, is how you will store the data model. What flows from that is how you will do deployment. Migration-Based Deployment This is still the most common model today and is a very traditional way to work with databases during development. At some point, you create an initial database, and after that, you keep every script that’s needed to bring the schema up to the current point.

2018-02-02

I keep doing work at sites where none of the database code is stored in version control (source control) systems. I keep wondering why that is. At a recent site, all the source code was in individual files just sitting in a single folder. That’s just not sensible. I’m left wondering why it is that almost every team that I see working with higher-level languages just assumes that some form of source control would be used, yet it’s almost the opposite when I’m working with data teams.

2018-01-26

For many years now, it has been important to script the configuration and deployment of systems, particularly virtual machines. Infrastructure as Code is now a common requirement but as the required configuration has become more complex, scripting in language like PowerShell has become more difficult. It’s all very well to write code to add say a network adapter, but how do you check the current state of the machine? Did that adapter already exist?

2018-01-19

One of the principles of DevOps is that you should be able to deploy regularly, with smaller low-risk changes. This addresses a key problem that I see in many sites: Each code release is large The code is difficult to test Code merges are painful Deployments take a long time Deployments often fail Deployments are considered to be high-risk procedures The end result of this situation is that deployments are avoided and then a snowball effect occurs where:

2018-01-12

In the second half of 2016, I enrolled in the Microsoft Professional Program for Data Science, and completed it in early 2017. I have to say that I really enjoyed it overall. It was a bit challenging at times but I don’t regret doing it. If you want to get the certification, you need to enroll in the verified option for each course. Nowadays, that’s pretty much $99 USD per course.

2018-01-05