Fabric Data Engineer

Job Overview

We are looking for an experienced Data Engineer specializing in Microsoft Fabric to join our team on a contract basis in Letterkenny, County Donegal, Ireland. This role involves designing, developing, and managing comprehensive data pipelines and frameworks to support analytics and reporting needs.

Key Responsibilities

• Create and manage end-to-end data pipelines using Microsoft Fabric technologies.
• Develop scalable, reusable data frameworks, emphasizing configuration-driven pipeline architectures and centralized configuration management across multiple pipelines.
• Build and maintain Spark notebooks and pipelines for data processing.
• Implement ETL/ELT workflows utilizing SQL, Spark, and Python to transform raw data into actionable insights.
• Conduct data modeling and transformations to facilitate effective analytics and reporting.
• Engage collaboratively with architecture and engineering teams to establish robust data solutions.
• Ensure compliance with enterprise standards including documentation in Confluence, CI/CD deployment pipelines, and coding guidelines.
• Support deployment activities across diverse client environments.
• Manage deliverables from conception to completion with minimal oversight.

Required Skills and Experience

• At least 8 years of professional experience as a Data Engineer.
• Minimum 2 years of practical expertise with Microsoft Fabric platforms.
• Alternatively, solid background with Azure Synapse Analytics and associated Azure data services such as ADF, Databricks, and Delta tables.
• Certification in Microsoft Fabric is advantageous.
• Proficiency in SQL, data modeling, and ETL/ELT pipeline development.
• Experience using Spark notebooks/pipelines or Python scripting for data engineering.
• Ability to create semantic models and produce BI reports.
• Demonstrated capability designing scalable and orchestrated data solutions.
• Familiarity with CI/CD deployment workflows.

Desirable Attributes

• Experience in building generic or reusable data framework components.
• Comfortable with enterprise documentation protocols, for instance, Confluence.

Soft Skills

• Proactive and demonstrates rapid learning capabilities.
• Strong ownership and accountability for projects and outcomes.
• Can operate autonomously in high-pressure, fast-moving environments.
• Effective communicator with solid teamwork and collaboration abilities.