General: Happy New Year to all my readers

General: Happy New Year to all my readers

So 2025 is done. It was both an interesting and a challenging year for me. I’m so glad for all you who have been reading my blog and hope you’ll continue into the future.

What Will Matter Most for Data Professionals in 2026?

As a new year begins, it’s a good time to pause and look ahead — not with hype or predictions, but with a practical view of what will genuinely matter for data professionals in 2026. Across consulting projects, training course development, and hands-on work with SQL Server, Microsoft Fabric, and modern data platforms, several patterns have emerged that are shaping how teams build and operate data solutions.

I thought I should put together some thoughts from my crystal ball, for the upcoming year, covering the trends and skills that will have the greatest impact this year, and where developers and DBAs may want to focus their learning.

Real-Time Becomes the Default Expectation

Real-time workloads are no longer limited to specialised teams. Smaller organisations are starting to expect streams, low-latency insights, and continuous ingestion as standard capabilities.

Microsoft Fabric’s Real-Time Intelligence features accelerate this shift by making event ingestion, processing, actions, and anomaly detection accessible without complex infrastructure.

What’s changing:

  • More systems are event-driven by design
  • Latency and freshness become first-class architectural decisions
  • Monitoring and alerting pipelines evolve from batch to continuous patterns

A basic understanding of event ingestion, schema sets, snapshots, windows, and triggers will be increasingly important.

Developers Need Stronger Architectural Awareness

This year will put more emphasis on understanding the environment around the database, not just the code inside it. High availability, distributed systems, and resilience patterns are now part of day-to-day work—even for developers.

Key areas to understand:

  • Failover cluster instances and availability groups
  • Hybrid and cross-region architectures
  • Latency effects on distributed queries and microservices
  • Observability patterns: logs, traces, metrics

Well-designed systems handle failure gracefully. That requires architectural awareness, not just correct SQL.

A Shift from Classical Pipelines to Declarative Data Flows

ETL pipelines are not disappearing, but the tooling is changing. Declarative and metadata-driven data flows (such as Fabric Data Factory) reduce the amount of orchestration developers need to maintain.

What this means for 2026:

  • More transformations will be designed visually but expressed declaratively
  • Data quality and lineage will be expected as built-in features
  • Low-code and pro-code tools will coexist rather than compete
  • Pipeline sprawl will reduce as teams consolidate platforms

ETL fundamentals remain critical—especially understanding source behaviour, incremental loads, and data contracts.

AI-Assisted Development Becomes a Standard Practice

AI is not replacing developers, but developers who use AI will outpace those who don’t. In 2026, AI support will feel like part of the workflow rather than an optional add-on.

Examples already appearing:

  • AI-generated SQL templates and code scaffolding
  • Using vector data types and embeddings for search or anomaly detection
  • Automated analysis of execution plans
  • AI-powered debugging of pipelines and DAX formulas

The emphasis this year will be on correctness, validation, and responsible use rather than experimentation.

Performance Fundamentals Come Back Into Focus

Despite the increasing abstraction of data platforms, performance tuning remains essential. Cloud environments have made it easy to scale up, but not cost-effectively.

Teams are rediscovering that:

  • Indexing strategy still matters
  • Parameter sniffing still appears in problematic designs
  • Poor cardinality estimates continue to cause surprises

Execution plan literacy is an essential career skill. Good design prevents far more issues than hardware can solve.

Cross-Platform SQL Skills Become More Valuable

Few teams live on a single database engine anymore. Developers and DBAs are supporting combinations of:

  • SQL Server
  • PostgreSQL
  • MySQL
  • Snowflake
  • Oracle (including XE for training and prototyping)
  • Cosmos DB

This means SQL fluency matters more than vendor-specific dialects.

What’s increasing in importance:

  • Consistent naming conventions
  • Understanding standard SQL behaviours
  • Avoiding engine-specific anti-patterns
  • Designing schemas portable across platforms

Cross-platform knowledge helps avoid lock-in and fosters better architectural decisions.

Data Quality and Observability Become Mandatory

As systems become more real-time and more interconnected, observability is no longer optional.

Key practices that will matter in 2026:

  • Validating data at ingestion rather than downstream
  • Adding metrics to measure data freshness, throughput, and completeness
  • Capturing lineage automatically
  • Using simple rules-based checks before relying on AI-based detection

Teams that treat data quality as part of the core design will ship more reliable solutions.

A Practical Learning Roadmap for 2026

For professionals planning where to invest time this year, a balanced skill set will deliver the highest return.

Suggested areas to focus on:

  • SQL fundamentals: indexing, joins, SARGability, and execution plans
  • High availability and disaster recovery in SQL Server
  • Microsoft Fabric Real-Time Intelligence: events, streams, actions, KQL
  • Fabric Data Factory and modern declarative data flows
  • Basic cloud architecture patterns
  • Observability and monitoring techniques
  • AI-assisted coding and debugging
  • Cross-platform SQL design and naming conventions

Small, consistent learning sessions throughout the year often outperform large bursts of training. We already cover most of these with our online on-demand training at SQL Down Under but we’ll be doing even more this year.

Closing Thoughts

2026 looks to be a year where the fundamentals and the new wave of real-time capabilities meet. Teams that combine a solid understanding of SQL, modern data platform features, and architectural best practices will move quickly and deliver reliable systems.

If you work with data—whether as a developer, DBA, or engineer—this is an excellent year to strengthen your core skills while exploring the new tooling and approaches that are becoming mainstream.

I hope the new year is kind to both you and your families.

2026-01-01