Summary: Seeking a Lead Python Data Engineer to set technical direction for data services in Microsoft Azure, focusing on pipelines, automation, and APIs. Highlights: 1. Lead architecture and rollout of advanced data pipelines 2. Develop and maintain Azure solutions with cutting-edge technologies 3. Automate environment provisioning with Bicep and AI-assisted development We are delivering production\-grade data services in Microsoft Azure and need a Lead Python Data Engineer to set technical direction for pipelines, automation, and APIs. You will lead FastAPI services and background processing, implement CI/CD in GitHub Actions, and automate Infrastructure as Code with Bicep across Azure Storage, Azure Container Apps, and Azure SignalR Service. Apply today and help us scale with confidence **Responsibilities** * Build and evolve FastAPI web services along with background processing jobs * Lead architecture and rollout of data pipelines using data lakes, medallion architecture, and star schema models * Operate data processing and reporting pipelines with Pandas, Polars, openpyxl, and DuckDB * Coordinate CI/CD execution by setting up and maintaining GitHub Actions workflows * Develop and maintain Azure solutions using Azure Container Apps, Azure Storage, Azure Service Bus, and Azure SignalR Service * Automate environment provisioning in Azure with Bicep and leverage AWS CDK or Terraform knowledge when applicable * Execute specification\-driven development using GitHub Copilot and Claude Code * Incorporate Airflow, dbt, or Streamlit components based on solution needs **Requirements** * Demonstrated 5\+ years of experience in Python development and data engineering with leadership exposure * Extensive experience using Pandas, Polars, openpyxl, and DuckDB in data processing workflows * Strong command of FastAPI for web services as well as background jobs * Proficiency in CI/CD setup and maintenance via GitHub Actions and IaC automation using Bicep * Advanced Microsoft Azure solution engineering skills with Azure Container Apps, Azure Storage, Azure Service Bus, and Azure SignalR Service * Deep understanding of data lakes, medallion architecture, and star schema design principles * Proven capability applying AI\-assisted development with GitHub Copilot and Claude Code * Familiarity with tools including Airflow, dbt, or Streamlit * Ability to reuse AWS CDK or Terraform experience to deliver Azure infrastructure **Nice to have** * Understanding of distributed processing, asynchronous workflows, and enterprise messaging patterns * Experience with Snowflake stored procedures, streams, tasks, pipes, and time travel * Experience with .NET Core web development * Familiarity with Angular or Next.js web applications