···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: Seeking a Lead Python Data Engineer to drive the expansion of an Azure data platform by defining scalable pipelines, services, and reporting standards. Highlights: 1. Lead delivery of FastAPI APIs and background jobs 2. Define pipeline architecture around data lakes and medallion architecture 3. Drive Azure development using Container Apps, Azure Storage, and Service Bus We are expanding our Azure data platform and are looking for a Lead Python Data Engineer to define scalable pipelines, services, and reporting standards. You will lead delivery of FastAPI APIs and background jobs while applying lakehouse concepts, CI/CD with GitHub Actions, and IaC with Bicep. Submit your application to help elevate our data systems. **Responsibilities** * Design and deliver FastAPI\-based web services and background workflows * Develop data transformation and reporting pipelines using Pandas, Polars, openpyxl, and DuckDB * Define pipeline architecture around data lakes, medallion architecture, and star schema patterns * Maintain and improve CI/CD automation with GitHub Actions * Drive Azure development using Container Apps, Azure Storage, Service Bus, and SignalR * Provision and manage infrastructure using Bicep on Azure or equivalent AWS CDK or Terraform skills * Apply specification\-driven approaches with AI\-assisted tooling like GitHub Copilot and Claude Code * Embed orchestration frameworks into pipelines using Airflow, dbt, or Streamlit **Requirements** * Demonstrated success in Python development for data engineering with 5\+ years of experience * Practical experience with Pandas, Polars, openpyxl, or DuckDB to prepare, analyze, and report on data * Strong experience creating web services and background jobs with FastAPI * Thorough knowledge of data lakes, medallion architecture, or star schema for end\-to\-end pipeline design * Proven ability to implement CI/CD using GitHub Actions * Advanced Azure skills with Container Apps, Azure Storage, Service Bus, or SignalR * Hands\-on Infrastructure as Code capability using Bicep or comparable experience with AWS CDK or Terraform * Working familiarity with AI\-assisted coding tools such as GitHub Copilot or Claude Code * Exposure to orchestration and reporting tools including Airflow, dbt, or Streamlit **Nice to have** * Understanding of distributed data processing, async task execution, or enterprise messaging * Snowflake expertise covering stored procedures, streams, tasks, pipes, and time travel features * Background in .NET Core web development * Experience in front\-end frameworks such as Angular or Next.js

Source:  indeed View original post
Sofía González
Indeed · HR

Company

Indeed
Sofía González
Indeed · HR
Similar jobs

Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.