Lead Data Engineer

Description

Summary: Lead Data Engineer to modernize data environments with cloud and lakehouse solutions using Databricks, focusing on scalable pipeline delivery, data migration, and governance. Highlights: 1. Modernize data environments using cloud and lakehouse solutions with Databricks 2. Lead scalable pipeline delivery, data migration, and governance initiatives 3. Collaborate with multi-national teams on innovative projects We are looking for a **Lead Data Engineer** to modernize data environments for the project, focusing on cloud and lakehouse solutions using Databricks. You will lead scalable pipeline delivery, data migration, and governance while partnering with technical and business teams—apply now to help build a reliable modern data platform. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi\-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting\-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. **Responsibilities** * Design scalable batch and streaming data pipelines * Deliver data migration initiatives from on\-premises to cloud or between platforms * Develop and optimize data solutions using Databricks and Apache Spark * Build ETL/ELT processes aligned with data engineering best practices * Elicit requirements with technical and business teams in a consulting context * Ensure data quality, governance, and security across platforms * Monitor and optimize cloud performance and cost * Troubleshoot and resolve production pipeline issues * Document architectures, technical processes, and migration strategies **Requirements** * 5\+ years of experience as a Data Engineer * Proven consulting experience working with clients and stakeholders * Hands\-on experience with data migration projects, from legacy systems to cloud or platform\-to\-platform * Expertise in Databricks for development and optimization * Proficiency in advanced SQL and data modeling * Skills in Python or Scala for data engineering workloads * Upper\-Intermediate English proficiency (B2, upper\-intermediate) * Strong analytical and solution\-oriented mindset * Clear communication skills and teamwork focus * Proactive attitude with strong ownership mindset **Nice to have** * Databricks certification * Experience with CI/CD for data pipelines * Skills in Infrastructure as Code with Terraform or ARM * Experience in Spark performance tuning * Familiarity with Power BI, Kafka, or Unity Catalog **We offer** * Connectivity Bonus (25,000 ARS are paid with a salary receipt at the end of each month as a non\-wages concept). * Medicina Prepaga (It covers the collaborator and direct family group). * Paternity Leave (Two additional days are added to what is established by law, total of 4 days). * Discounts card. * English Training (English lessons, twice per week). * Training Program (Access to multiple customized training plans according to the needs of each role within the company). * Marriage bonus (The company doubles the allowance established by law that ANSES offers). * Referral Program (Referral bonus is paid when the referral of a collaborator joins the Company). * External Agreements and Discounts. * Vacations: 14 calendar days a year *By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM´s Privacy Notice and Policy.*