Summary: Lead Python Data Engineer to expand Azure data lakehouse, leading high-throughput pipelines and FastAPI web services with automation and Azure component coordination. Highlights: 1. Lead high-throughput pipelines and FastAPI web services 2. Drive end-to-end data pipeline implementation with data lakes and star schema 3. Apply specification-driven development with AI assistance for quality delivery We are expanding our Azure data lakehouse and need a Lead Python Data Engineer to lead high\-throughput pipelines and FastAPI\-based web services. You will steer automation via GitHub Actions and Infrastructure as Code with Bicep, while coordinating Azure components like Azure Container Apps, Azure Storage, and Azure Service Bus. Submit your application to take ownership of delivery and quality **Responsibilities** * Architect FastAPI web services and background processing jobs for reliable execution * Drive end\-to\-end data pipeline implementation using data lakes, medallion architecture, and star schema models * Handle data processing and reporting using Pandas, Polars, openpyxl, and DuckDB * Optimize CI/CD by configuring, monitoring, and updating GitHub Actions workflows * Oversee Azure solution delivery across Azure Container Apps, Azure Storage, Azure Service Bus, and Azure SignalR Service * Provision and manage Azure infrastructure using Bicep, reusing AWS CDK or Terraform experience where helpful * Apply specification\-driven development with GitHub Copilot and Claude Code to accelerate quality delivery * Add Airflow, dbt, or Streamlit functionality as project needs dictate **Requirements** * 5\+ years of professional experience in Python development and data engineering, plus leadership experience in delivery * Strong proficiency with Pandas, Polars, openpyxl, and DuckDB for transforming and analyzing data * Advanced FastAPI knowledge for implementing web services and background processing jobs * Solid experience setting up CI/CD pipelines with GitHub Actions and automating IaC using Bicep * Expert\-level Microsoft Azure skills with Azure Container Apps, Azure Storage, Azure Service Bus, and Azure SignalR Service * Thorough understanding of data lakes, medallion architecture, and star schema modeling * Proven track record using GitHub Copilot and Claude Code for AI\-assisted development * Awareness of orchestration and analytics tooling such as Airflow, dbt, or Streamlit * Transferable knowledge of AWS CDK or Terraform applied to Azure environments **Nice to have** * Understanding of distributed compute, async workflows, and enterprise messaging patterns * Snowflake experience with stored procedures, streams, tasks, pipes, and time travel * Background in .NET Core web development * Knowledge of Angular or Next.js for building modern web applications