···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: Lead Python Data Engineer to evolve scalable Azure-based data systems with modern lakehouse patterns and disciplined delivery, solving complex architecture problems. Highlights: 1. Lead Python Data Engineer evolving Azure-based data systems 2. Engineer and improve data workflows with advanced Python libraries 3. Design and sustain data lakes, medallion layers, and star schemas We are developing scalable Azure\-based data systems in Python, combining strong backend engineering with modern lakehouse patterns and disciplined delivery. In the Lead Python Data Engineer position, you will evolve data processing with Pandas, Polars, openpyxl, and DuckDB, and standardize deployments through GitHub Actions and IaC. Join us to solve complex architecture problems—apply now. **Responsibilities** * Oversee Python services and background jobs, using FastAPI where applicable * Engineer and improve data workflows with Pandas, Polars, openpyxl, and DuckDB * Design and sustain data lakes, medallion layers, and star schemas to support analytics needs * Optimize CI/CD pipelines and release automation through GitHub Actions * Deploy and operate Azure solutions on Container Apps with Azure Storage, Service Bus, and SignalR * Maintain infrastructure definitions via Bicep or comparable tools such as AWS CDK and Terraform * Promote effective usage of GitHub Copilot and Claude Code across the engineering team * Work with multiple teams to improve scalability and streamline overall performance * Resolve senior\-level architectural and engineering challenges using advanced best practices * Drive monitoring practices and ensure rapid resolution of critical issues to maintain system fidelity **Requirements** * Extensive Python experience (5\+ years) creating web services and handling background processing with FastAPI * Leadership experience for 1\+ years owning technical outcomes in a similar role * Deep understanding of Pandas, Polars, openpyxl, and DuckDB for processing pipelines * Proven track record designing medallion layers, data lakes, and star schemas * Expertise in GitHub Actions for CI/CD implementation and scaling * Hands\-on experience with Azure Container Apps, Azure Storage, Service Bus, and SignalR * Mastery of IaC using Bicep, AWS CDK, or Terraform * Proven ability to use GitHub Copilot and Claude Code to improve development efficiency * English proficiency at B2\+ (Upper\-Intermediate) to communicate clearly **Nice to have** * Experience with Airflow, dbt, and Streamlit for orchestration and transformation workflows * Understanding of distributed processing, asynchronous workflows, and enterprise messaging patterns * Experience using Snowflake, including streams, tasks, pipes, stored procedures, and time travel capabilities * Background in .NET web development for legacy front\-end solutions built with .NET Core * Knowledge of Angular or Next.js for web development

Source:  indeed View original post
Sofía González
Indeed · HR

Company

Indeed
Sofía González
Indeed · HR
Similar jobs

Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.