Senior Data Software Engineer

Description

Summary: Seeking a Senior Data Software Engineer to architect, maintain, and provide technical leadership for robust data solutions, collaborating directly with clients. Highlights: 1. Architect and maintain code for ETL/ELT pipelines and large-scale systems 2. Provide technical leadership and ensure high-quality delivery 3. Design innovative data services solutions using various technologies We are looking for a **Senior Data Software Engineer** to join our team and collaborate directly with our client on building robust data solutions. In this role, you will architect and maintain code for ETL/ELT pipelines, large\-scale batch and streaming systems, while providing technical leadership and ensuring high\-quality delivery throughout the project lifecycle. **Responsibilities** * Architect and maintain the code base for ETL and ELT pipelines, large batch/micro batch processing and streaming systems * Build out the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using ADF, Spark, Kafka or similar technologies * Identify, design and implement internal process improvements, including automating manual processes, optimizing data delivery and re\-designing infrastructure for greater scalability * Design and implement innovative data services solutions using Spring Boot, ReactJS, NoSQL or other UI and API related technologies * Assure governance of processes in delivery management and production as per selected delivery model * Act as a single point of responsibility over any delivery\-related matters for top management and stakeholders, including escalations, upsells and ramp\-downs * Provide technical leadership regarding the delivery, ensuring a sound and future\-proof architecture is planned and the implementation meets the technical quality standards * Write stories and associated acceptance criteria for agile/scrum workflow * Coordinate between multiple disciplines and stakeholders * Ensure that projects are delivered in line with client processes and methodologies, with focus on agile approaches * Establish a strategy of continuous delivery risk management that enables proactive decisions and actions throughout the delivery life cycle * Measure and improve delivery productivity, serve as a consultant to Data Engineers and perform production support and deployment activities **Requirements** * 3\+ years of experience in SQL, Spark and Scala * Expertise in Databricks * Background in designing and implementing ETL/ELT pipelines and large batch/micro batch processing systems * Familiarity with data services solutions using Spring Boot, ReactJS and NoSQL or other UI and API related technologies * Understanding of agile/scrum workflow and different delivery models * Capability to provide technical leadership and act as a consultant to Data Engineers * English proficiency at B2 level or higher for direct communication with the client **Nice to have** * Skills in Spark Streaming and Kafka * Familiarity with Azure **We offer** * International projects with top brands * Work with global teams of highly skilled, diverse peers * Healthcare benefits * Employee financial programs * Paid time off and sick leave * Upskilling, reskilling and certification courses * Unlimited access to the LinkedIn Learning library and 22,000\+ courses * Global career opportunities * Volunteer and community involvement opportunities * EPAM Employee Groups * Award\-winning culture recognized by Glassdoor, Newsweek and LinkedIn