Fabric Data Engineer

About the Role

We are seeking an experienced Data Engineer specialized in Microsoft Fabric to design, implement, and manage comprehensive data pipelines and frameworks. This role involves developing scalable and reusable data architectures centered on Microsoft Fabric or Azure Synapse Analytics and related Azure data services.

Key Responsibilities

• Design and implement end-to-end data pipelines leveraging Microsoft Fabric technologies.
• Develop scalable, reusable data frameworks incorporating configuration-driven pipeline architectures and centralized configuration management for multiple pipelines.
• Create and maintain Spark notebooks and pipelines for efficient data processing.
• Implement ETL and ELT workflows using SQL, Spark, and Python to prepare data for analytics and reporting.
• Perform data modeling and transformations suitable for business intelligence and reporting purposes.
• Collaborate closely with architectural and engineering teams to devise robust, enterprise-grade data solutions.
• Ensure compliance with enterprise standards including detailed Confluence documentation, adherence to CI/CD pipelines for deployments, code quality standards, and deployment procedures.
• Support deployments across various client environments and independently own deliverables from conception to implementation.

Candidate Requirements

• Minimum 8 years of professional experience as a Data Engineer.
• At least 2 years of hands-on experience with Microsoft Fabric, or alternatively a strong background in Azure Synapse Analytics along with Azure Data Factory, Databricks, and Delta tables.
• Candidates certified in Microsoft Fabric are preferred but not mandatory.
• Proficiency in SQL, data modeling, and ETL/ELT process development.
• Practical experience with Spark notebooks or Python programming tailored for data engineering applications.
• Ability to create semantic data models and generate business intelligence reports.
• Proven track record of designing scalable and orchestrated data solutions.
• Experience working with CI/CD pipelines and enterprise deployment processes.

Preferred Qualifications

• Experience developing generic or reusable data frameworks.
• Familiarity with enterprise documentation practices such as using Confluence.

Personal Attributes

• Self-motivated and quick to adapt to new technologies and workflows.
• Strong ownership mindset and accountability for project deliverables.
• Ability to operate independently within a dynamic, fast-paced environment.
• Effective communication skills and the ability to collaborate well within diverse teams.