Data Engineer Specialized in Databricks | Full Remote LATAM

Description

Job Summary: Blackbook.ai is hiring a Data Engineer specialized in Databricks to design and build modern data platforms, transforming business needs into effective technical solutions. Key Highlights: 1. Design and build modern data platforms with Databricks. 2. Collaborate on international projects for North American clients. 3. Collaborative environment with professional development and continuous training. We are **Blackbook.ai**, an **Australian technology consulting firm** specializing in Automation, Digital Solutions, Applied Artificial Intelligence, and Data Engineering. For over 10 years, we have helped organizations across diverse industries transform and optimize their operations through technology. We are currently onboarding a **Data Engineer specialized in Databricks** to join our AI and Data team, in a **full-time** and **fully remote role based in Latin America**. The position requires **working entirely in English**, due to the international nature of our projects and clients. We seek a professional with hands-on experience designing and building modern data platforms, focused on delivering tangible impact for users and businesses. We value a pragmatic mindset, autonomy, ability to solve complex problems, and enthusiasm for participating in international projects—primarily serving the North American market. **Key Responsibilities** * Design, build, and deliver analytical solutions on the **Databricks** platform. * Design and build cloud architectures on Azure and/or AWS, using Databricks as the primary platform for compute, transformation, and analytics. * Design and build metadata-driven data ingestion and transformation pipelines using Databricks Auto Loader, Delta Live Tables (DLT), Delta Lake, and Apache Spark. * Implement and work with Databricks Unity Catalog for data governance, lineage, security, and access control. * Use Databricks SQL and Databricks Workflows to deliver scalable and maintainable Lakehouse solutions. * Collaborate with clients to gather requirements, analyze business needs, and translate them into effective technical solutions. * Participate in Agile ceremonies, including sprint planning, daily stand-ups, reviews, and retrospectives. * Collaborate with internal and distributed teams across different regions, contributing to engineering best practices, documentation, and delivery. **Requirements** * Bachelor’s degree in Computer Science, Engineering, Systems, or related fields. * Hands-on experience with the Databricks platform, including Delta Lake, Spark, PySpark, Spark SQL, DLT, and Databricks Workflows. * Professional conversational English, with the ability to clearly communicate ideas, collaborate with stakeholders, and confidently engage in client-facing discussions. * Strong development skills in PySpark, Spark SQL, and/or relational databases such as SQL Server or PostgreSQL. * Experience working with cloud platforms, ideally Azure or AWS. * Excellent communication and presentation skills, including technical documentation, verbal and written communication, and solution modeling. * Critical thinking, problem-solving, and technical decision-making capabilities. * Ability to work both independently and collaboratively within a team. * Legal right to work from your country of residence in Latin America. Desirable * Databricks Certified Data Engineer Associate or Databricks Certified Data Engineer Professional certification. * Certification in Azure, AWS, Data Engineering, or Architecture. * Experience with Azure Data Factory or AWS Glue for orchestration and integration alongside Databricks. * Experience with MLflow or Databricks Model Serving for integrating ML/AI workloads. * Knowledge of PowerShell, Azure CLI, AWS CLI, or Terraform for automation and infrastructure-as-code. * Experience in consulting environments or international client projects. At Blackbook.ai, we offer a collaborative, dynamic, and high-quality solution delivery environment, with a strong emphasis on culture, teamwork, and professional development. We have a large team of specialized consultants who will support your growth, along with opportunities for continuous training and access to relevant certifications for your role. We offer a competitive salary, excellent benefits, and the opportunity to participate in high-impact international projects. If you’re interested in joining a dynamic team and working on modern data solutions, we’d love to meet you. **Apply by submitting your CV in English.** Job Types: Full-time, Permanent Education: * Bachelor's (Required) Experience: * Databricks: 1 year (Required) Language: * English (Required) Work Location: Remote