···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: Seeking a Lead Python Data Engineer to modernize an Azure lakehouse, lead pipeline and service development, and coordinate with teams. Highlights: 1. Lead architecture for FastAPI services and background workflows 2. Strengthen CI/CD via GitHub Actions and manage IaC with Bicep 3. Shape pipeline architecture leveraging data lakes and medallion architecture We are modernizing our Azure lakehouse and need a Lead Python Data Engineer to lead how we build pipelines, background processing, and reporting services. You will coordinate with multiple teams to deliver FastAPI services, strengthen CI/CD via GitHub Actions, and manage IaC with Bicep while using proven data modeling patterns. Apply today to make a measurable impact. **Responsibilities** * Own architecture for FastAPI web services and background workflows * Create and improve transformation and reporting pipelines with Pandas, Polars, openpyxl, and DuckDB * Shape pipeline architecture leveraging data lakes, medallion architecture, and star schema * Operate and enhance CI/CD automation using GitHub Actions * Lead Azure implementation with Container Apps, Azure Storage, Service Bus, and SignalR * Automate infrastructure setup with Bicep or apply transferable AWS CDK or Terraform experience * Use specification\-driven development with AI\-assisted tools like GitHub Copilot and Claude Code * Connect orchestration frameworks to pipelines using Airflow, dbt, or Streamlit **Requirements** * Proven track record delivering Python data engineering solutions with 5\+ years of experience * Hands\-on proficiency using Pandas, Polars, openpyxl, or DuckDB for data structuring, analysis, and reporting * Solid background implementing web services and background jobs with FastAPI * Deep understanding of data lakes, medallion architecture, or star schema to guide pipeline design decisions * Experience setting up CI/CD workflows through GitHub Actions * Extensive experience building on Azure with Container Apps, Azure Storage, Service Bus, or SignalR * Competency with Infrastructure as Code using Bicep or equivalent experience with AWS CDK or Terraform * Familiarity with AI\-assisted coding tools such as GitHub Copilot or Claude Code * Knowledge of orchestration and reporting tools including Airflow, dbt, or Streamlit **Nice to have** * Understanding of distributed data processing, async task execution, or enterprise messaging * Snowflake expertise including stored procedures, streams, tasks, pipes, and time travel features * Background in .NET Core web development * Experience with front\-end frameworks such as Angular or Next.js

Source:  indeed View original post
Sofía González
Indeed · HR

Company

Indeed
Sofía González
Indeed · HR
Similar jobs
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.