




Summary: Seeking a Senior Python Data Engineer to design modern Azure lakehouse pipelines, engineer Python processing, reporting, and service layers, and automate CI/CD and IaC. Highlights: 1. Engineer modern Azure lakehouse pipelines with Python 2. Design medallion and star schema pipelines with FastAPI services 3. Automate CI/CD and IaC with GitHub Actions and Bicep We are delivering modern Azure lakehouse pipelines and need a Senior Python Data Engineer to engineer Python processing, reporting, and service layers. You will design medallion and star schema pipelines, run FastAPI services with background jobs, and automate CI/CD and IaC with GitHub Actions and Bicep—apply now. **Responsibilities** * Implement FastAPI services and background jobs * Develop and tune workflows for processing and reporting with Pandas, Polars, openpyxl, and DuckDB * Define pipeline designs using data lakes, medallion architecture, and star schema * Configure and improve CI/CD pipelines using GitHub Actions * Deploy Azure solutions using Container Apps, Azure Storage, Service Bus, and SignalR * Automate infrastructure deployment with Bicep or leverage AWS CDK or Terraform expertise * Follow spec\-driven development and use GitHub Copilot and Claude Code to accelerate delivery * Support orchestration and reporting integration using Airflow, dbt, or Streamlit **Requirements** * Proven Python development experience for data engineering (3\+ years) * Strong capability in Pandas, Polars, openpyxl, or DuckDB for processing and reporting workloads * Working experience with FastAPI for web services and background job execution * Deep understanding of data lakes along with medallion architecture or star schema concepts * Proficiency in GitHub Actions to automate CI/CD * Experience developing on Azure with Container Apps, Azure Storage, Service Bus, or SignalR * Competency in Bicep for infrastructure automation, or comparable experience with AWS CDK or Terraform * Ability to apply AI\-assisted development tools like GitHub Copilot or Claude Code * Familiarity with Airflow, dbt, or Streamlit for orchestration and reporting **Nice to have** * Understanding of distributed processing, async workflows, or enterprise messaging patterns * Snowflake exposure, including stored procedures, streams, tasks, pipes, or time travel * Prior .NET web development experience with .NET Core * Experience with Angular or Next.js in web development


