Data Engineering on Azure: Building My First ETL Pipeline

Thu, 05 Mar 2026 00:00:00 +0000

Data Engineering on Azure: Building My First ETL Pipeline

Day 4 of the cloud engineering transition. Today I crossed into data engineering territory — spinning up Azure Storage and Data Factory infrastructure with Bicep, then writing a Python ETL pipeline that pulls live weather data and lands it in Azure Blob Storage.

It’s a simple pipeline by design, but it covers the full ETL pattern that every data engineering project is built on.

Infrastructure as Code with Bicep: Deploying a Windows 11 Dev VM

Wed, 04 Mar 2026 00:00:00 +0000

Infrastructure as Code with Bicep: Deploying a Windows 11 Dev VM

Day 3 of the cloud engineering transition. Today’s goal was twofold — learn Infrastructure as Code using Azure Bicep, and solve a real problem: getting a proper Windows development environment accessible from an iPad via Microsoft’s Windows App.

The result is a Windows 11 VM provisioned entirely from code, with auto-shutdown at midnight, RDP access locked down via NSG, and a static public IP that doesn’t change between reboots. All deployed with a single command.

Bicep on Derrek

Data Engineering on Azure: Building My First ETL Pipeline

Data Engineering on Azure: Building My First ETL Pipeline

Infrastructure as Code with Bicep: Deploying a Windows 11 Dev VM

Infrastructure as Code with Bicep: Deploying a Windows 11 Dev VM