




Summary: Seeking a Lead Python Data Engineer to architect and deliver high-performance data services in Microsoft Azure, shaping pipeline architecture, processing, and reporting. Highlights: 1. Shape pipeline architecture, processing, and reporting in Azure 2. Partner with product and engineering peers to deliver modern data solutions 3. Drive modern data delivery using FastAPI, CI/CD, and IaC We are building high\-performance data services in Microsoft Azure and need a Lead Python Data Engineer to shape pipeline architecture, processing, and reporting. You will partner with product and engineering peers to deliver FastAPI web services, background processing, and lakehouse patterns using CI/CD and IaC. Apply now to help drive modern data delivery. **Responsibilities** * Architect web services and background workflows using FastAPI * Build and refine data transformation and reporting pipelines with Pandas, Polars, openpyxl, and DuckDB * Design and govern data pipeline architecture using data lakes, medallion architecture, and star schema * Implement CI/CD automation and maintain pipelines with GitHub Actions * Lead Azure solution delivery with Container Apps, Azure Storage, Service Bus, and SignalR * Automate infrastructure provisioning with Bicep on Azure or apply transferable AWS CDK or Terraform expertise * Adopt specification\-driven development using AI\-assisted tools like GitHub Copilot and Claude Code * Integrate orchestration frameworks into data pipelines using Airflow, dbt, or Streamlit **Requirements** * Proven track record in Python data engineering with 5\+ years of experience * Hands\-on proficiency with Pandas, Polars, openpyxl, or DuckDB for structuring, analyzing, and reporting data * Solid background in building web services and background jobs using FastAPI * Deep understanding of data lakes, medallion architecture, or star schema to design durable pipelines * Experience implementing CI/CD workflows using GitHub Actions * Extensive experience in Azure development with Container Apps, Azure Storage, Service Bus, or SignalR * Competency in Infrastructure as Code using Bicep or equivalent experience with AWS CDK or Terraform * Familiarity with AI\-assisted coding tools such as GitHub Copilot or Claude Code * Knowledge of orchestration and reporting tools including Airflow, dbt, or Streamlit **Nice to have** * Understanding of distributed data processing, async task execution, or enterprise messaging * Snowflake expertise including stored procedures, streams, tasks, pipes, and time travel features * Background in .NET Core web development * Experience with front\-end frameworks such as Angular or Next.js


