···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: Seeking a Lead Python Data Engineer to architect high-performance data solutions and lead innovation in pipeline design, background processing, and reporting within an Azure cloud ecosystem. Highlights: 1. Architect and deliver web services and background workflows using FastAPI 2. Lead development of Azure-based solutions 3. Shape advanced data systems with expertise in Python data engineering We are seeking a **Lead Python Data Engineer** to architect high\-performance data solutions and lead innovation in pipeline design, background processing, and reporting within an Azure cloud ecosystem. You will collaborate closely with cross\-functional teams, leveraging FastAPI, modern data lakehouse approaches, and scalable infrastructure to deliver impactful services. Join us and bring your expertise to shape advanced data systems—apply today. **Responsibilities** * Architect and deliver web services along with background workflows using FastAPI * Create and refine data transformation and reporting pipelines with Pandas, Polars, openpyxl and DuckDB * Design and oversee data pipeline architecture leveraging data lakes, medallion architecture, and star schema * Implement and manage CI/CD automation with GitHub Actions * Lead development of Azure\-based solutions using Container Apps, Azure Storage, Service Bus, and SignalR * Automate infrastructure setup with Bicep on Azure or transferable expertise from AWS CDK or Terraform * Adopt specification\-driven approaches with AI\-assisted tools like GitHub Copilot and Claude Code * Integrate orchestration frameworks into data pipelines using Airflow, dbt, or Streamlit **Requirements** * Proven track record in Python development for data engineering with at least 5 years of experience * Hands\-on proficiency with Pandas, Polars, openpyxl or DuckDB for structuring, analyzing, and reporting data * Solid background in creating web services and background jobs using FastAPI * Deep understanding of data lakes, medallion architecture, or star schema for designing robust pipelines * Experience implementing CI/CD workflows through GitHub Actions * Extensive experience in Azure development with Container Apps, Azure Storage, Service Bus, or SignalR * Competency in Infrastructure as Code using Bicep or equivalent experience with AWS CDK or Terraform * Familiarity with AI\-assisted coding tools such as GitHub Copilot or Claude Code * Knowledge of orchestration and reporting tools including Airflow, dbt, or Streamlit **Nice to have** * Understanding of distributed data processing, async task execution, or enterprise messaging * Snowflake expertise covering stored procedures, streams, tasks, pipes, and time travel features * Background in .NET Core web development * Experience in front\-end frameworks such as Angular or Next.js

Source:  indeed View original post
Sofía González
Indeed · HR

Company

Indeed
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.