Data Engineering Lead

About the Position

Join MortAI as a Data Engineering Lead based in Dublin, Ireland. This full-time onsite role offers a competitive yearly salary between 90,000 and 120,000 Euros. You will spearhead the creation of scalable data solutions and support the integration and processing of various data sources internally.

Key Responsibilities

• Lead the development, design, and implementation of scalable data engineering solutions.
• Construct and optimize extensive data pipelines to support analytics and machine learning applications.
• Design reusable, high-performance data frameworks and products.
• Incorporate data from various structured and unstructured sources into unified platforms.
• Automate workflows across data engineering and data science processes.
• Define and continuously improve data architecture ensuring scalability, reliability, and speed.
• Simplify complex systems, enhancing platform performance and efficiency.
• Enforce best practices in engineering design, coding standards, and reliability.
• Collaborate in designing distributed systems and cloud-based data platforms.
• Work closely with Data Scientists, Product Managers, and Engineering teams.
• Translate business demands into scalable technological solutions.
• Support cross-departmental delivery of data-driven products and services.
• Communicate technical information clearly to technical and non-technical audiences.
• Lead and mentor data engineers across projects and teams.
• Provide technical direction and contribute to building engineering expertise.
• Promote agile methodologies and foster collaborative practices.
• Maintain robust ETL/ELT pipelines and optimize data processing workflows for performance.
• Ensure data quality, consistency, and reliability across various platforms.
• Oversee production-grade deployment of data engineering solutions.

Required Qualifications and Experience

• At least eight years of professional experience in Data Engineering or Big Data environments.
• Proficiency in Python, Scala, or Java programming languages.
• Practical knowledge with Apache Spark and PySpark.
• Experience using Databricks platform.
• Familiarity with Hadoop ecosystem components including Hive, Impala, Oozie, Sqoop, and NiFi.
• Strong SQL capabilities and experience with both relational and NoSQL databases.
• Demonstrated experience building and managing large-scale data pipelines.
• Deep understanding of distributed systems and principles of data architecture.
• Experience working within Agile engineering teams.
• Proven leadership experience in technical initiatives or managing engineering teams.
• Bachelor’s degree or higher in Computer Science, Software Engineering, or a related discipline.
• Knowledge of cloud-native data engineering platforms, especially AWS or Azure environments.

Benefits and Opportunities

• Attractive salary package consistent with senior-level data engineering roles.
• Opportunity to engage with enterprise-scale payment technology platforms.
• Exposure to innovative Big Data, cloud, and analytics ecosystems.
• Leadership responsibilities within a global engineering organisation.
• Career advancement within a prominent international technology company.
• Chance to contribute to impactful data platforms underpinning analytics and AI solutions.
• Support and resources provided to foster your professional growth and potential.