···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: Seeking a Lead Python Data Engineer to guide scalable Azure architectures and pipelines, owning FastAPI-based services, background jobs, and data lakehouse patterns. Highlights: 1. Lead delivery of resilient data systems with scalable architectures 2. Own and improve Python backend services and background jobs using FastAPI 3. Standardize CI/CD via GitHub Actions and IaC with Bicep/AWS CDK/Terraform We are expanding our Azure data engineering capability and need a Lead Python Data Engineer to guide scalable architectures and pipelines. You will own FastAPI\-based services, background jobs, and data lakehouse patterns, while standardizing CI/CD via GitHub Actions and IaC with Bicep/AWS CDK/Terraform. Apply to lead delivery of resilient systems that stay reliable as complexity grows **Responsibilities** * Own and improve Python backend services and background jobs, leveraging FastAPI * Implement and refine data processing workflows with Pandas, Polars, openpyxl, and DuckDB * Lead design and maintenance of data lakes, medallion layers, and star schemas * Optimize and extend CI/CD processes using GitHub Actions * Deploy and manage scalable Azure solutions with Container Apps, Azure Storage, Service Bus, and SignalR * Create and maintain infrastructure definitions using Bicep or alternatives like AWS CDK and Terraform * Encourage GitHub Copilot and Claude Code usage to improve development efficiency * Coordinate with other teams to optimize scalability and end\-to\-end performance * Resolve high\-level architectural and engineering challenges aligned with best practices * Supervise monitoring and ensure timely resolution of critical issues to preserve system fidelity **Requirements** * Extensive Python experience (5\+ years) designing web services and operating background jobs with FastAPI * At least 1 year of relevant leadership experience mentoring and leading technical work * Deep understanding of Pandas, Polars, openpyxl, and DuckDB for robust processing * Proficiency with medallion layers, data lakes, and star schemas to support analytics * Advanced expertise with GitHub Actions for scalable CI/CD workflow implementation * Proven track record across Azure services: Container Apps, Service Bus, SignalR, and Azure Storage * Mastery of infrastructure\-as\-code with extensive experience in Bicep, AWS CDK, or Terraform * Proven ability to leverage GitHub Copilot and Claude Code to enhance engineering practices * English proficiency at B2\+ (Upper\-Intermediate) for clear communication **Nice to have** * Hands\-on work with Airflow, dbt, and Streamlit for orchestration and transformation * Deep knowledge of distributed processing, async workflows, and enterprise messaging patterns * Advanced Snowflake experience including streams, tasks, pipes, stored procedures, and time travel use cases * Significant .NET web development experience supporting legacy .NET Core front\-end solutions * Proven experience building web apps with Angular or Next.js

Source:  indeed View original post
Sofía González
Indeed · HR

Company

Indeed
Sofía González
Indeed · HR
Similar jobs

Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.