Cole Tramp's Microsoft Insights

Overview

A September 24, 2025 MSSQLTips comparison of Microsoft Fabric, Databricks, and Snowflake made one thing clear: this is no longer a decision between narrowly defined tools. All three platforms now extend well beyond where they started, with overlap across data engineering, warehousing, AI, governance, and real-time workloads.

What stands out even more is timing. That comparison took place more than half a year ago, and these platforms continue to evolve rapidly. Microsoft continues to expand Fabric as an end-to-end SaaS platform, Databricks continues to deepen its lakehouse and AI capabilities, and Snowflake continues to broaden its cloud data platform story well beyond traditional warehousing.

This brings me back to one of the first things I learned in IT: it is okay to be biased about technology, as long as that bias is grounded in business reality. The best platform is not the one with the longest feature list. It is the one that best fits your people, your environment, and your ability to execute.

Quick Comparison

Read More

Overview

As organizations scale their AI strategies, choosing between a small language model (SLM) and a large language model (LLM) becomes as much a business decision as a technical one. SLMs are typically valued for their efficiency, lower cost, and ability to perform targeted tasks well, while LLMs are better suited for broader reasoning, deeper context handling, and more advanced generative capabilities.

Read More

Read More

Overview

As Microsoft Fabric environments mature and become more collaborative, the risk of accidental deletion increases. A data engineer cleaning up a workspace, an analyst removing unused assets, or a contributor misunderstanding dependencies can easily delete the wrong item. Until recently, that deletion was permanent.

Microsoft Fabric now introduces item-level recovery through soft delete, providing a critical safety net for supported Fabric items. This capability complements existing workspace retention and adds fine-grained protection at the item level.

Item recovery allows deleted items to be retained for a configurable period, during which authorized users can restore them or permanently delete them. This feature is currently available in preview and must be explicitly enabled at the tenant level.

Prerequisites and Configuration

Read More

Overview

For many years, organizations commonly relied on on‑premises SQL Server as their enterprise data warehouse. While this approach made sense when cloud platforms were immature, it is no longer necessary, or efficient, in modern analytics architectures. Microsoft Fabric fundamentally changes this model by providing purpose-built, cloud-native analytical engines that eliminate the need to manage traditional data warehouse infrastructure.

Within Fabric, SQL Database and Data Warehouse serve different but complementary roles. Understanding when to use each is critical to building a scalable, governed, and future-proof data platform.

Instead of lifting and shifting legacy SQL Server workloads into the cloud, organizations can now adopt services designed specifically for analytical patterns, elasticity, and tight integration with the broader Fabric ecosystem.

 

The Shift Away from On-Prem SQL Server as a Data Warehouse

Read More

Overview

The data engineering community has long embraced dbt (Data Build Tool) for its simple, SQL-first approach to building, testing, and orchestrating data transformations. Historically, teams using dbt with Microsoft Fabric had to rely on external compute (local development machines, GitHub Actions, Azure DevOps pipelines, virtual machines, or standalone orchestration platforms like Airflow). These setups worked, but they added friction: managing environments, handling adapters, configuring authentication, and monitoring transformation jobs across disparate systems.

With dbt jobs now running natively inside Microsoft Fabric, that fragmentation disappears. dbt is no longer an external tool bolted onto the modern data estate, it is now a first‑class, integrated capability of Fabric, providing a unified experience for modeling, testing, scheduling, and monitoring transformations directly inside Fabric workspaces.

dbt, Natively Integrated: What’s New

Read More

Overview

Microsoft Fabric has been steadily transforming the data landscape with its unified analytics platform. One of its most powerful components, Fabric Data Agents, enables organizations to automate data workflows, orchestrate pipelines, and manage complex data operations with ease. Now, with these Data Agents being consumed into Microsoft 365 Copilot, the game changes entirely. This integration bridges the gap between enterprise data and everyday productivity tools, making insights more accessible and actionable than ever before.

More than 28,000 customers are already leveraging Microsoft Fabric, including 80% of the Fortune 500. This adoption underscores the trust and scale behind the platform and now, bringing that capability into Copilot amplifies its impact across the enterprise.

Key Points

Read More

Overview

Modernizing a data pipeline isn’t just about adopting the latest technology, it’s about choosing the right foundation for your data. File formats play a critical role in performance, scalability, and governance. Two widely used formats in modern data lakes are Parquet and Delta. While Parquet is a columnar storage format optimized for analytics, Delta builds on Parquet by adding transactional consistency and metadata management. Understanding how they work together and when to use each is key to designing a future-ready architecture.

Key Considerations: Parquet vs Delta

Read More

                         

Overview

In today’s data-driven world, it’s easy to get caught up in advanced architectures and cutting-edge tools. But before diving into complex solutions, understanding the fundamentals is critical. One of the most important distinctions in data processing is Batch vs Streaming (Real-Time). These two paradigms define how data moves, how it’s processed, and ultimately how insights are delivered.

Batch processing has been the backbone of analytics for decades, enabling organizations to process large volumes of data at scheduled intervals. Streaming, on the other hand, focuses on processing data as it arrives, delivering insights in real time. Both approaches have their place, and knowing when to use each is essential for building efficient, cost-effective, and scalable solutions.

In this article, we’ll break down what batch and streaming mean, how they work, and why understanding these basics is the foundation for any modern data strategy.

How It Works: Batch vs Streaming

Read More

Overview

Real-time data processing is no longer optional; it’s essential for businesses that want to act on insights instantly. Microsoft offers two powerful solutions for streaming analytics: Azure Stream Analytics (ASA) and Microsoft Fabric Eventstreams. Both enable organizations to capture, process, and analyze data as it arrives, but they take different approaches to solving the same challenge.

Azure Stream Analytics has been a trusted platform for years, delivering robust, developer-focused capabilities for complex event processing. Meanwhile, Fabric Eventstreams introduces a modern, SaaS-based experience that simplifies real-time data integration and analytics for everyone, not just developers. This shift signals where Microsoft is heading: toward a unified, accessible, and future-ready data ecosystem.

In this article, we’ll break down how each solution works, their key differences, and why Fabric Eventstreams is positioned as the future of real-time analytics.

 

How It Works: Azure Stream Analytics and Fabric Eventstreams

Read More