Azure Data Engineer

About Deloitte Technology & Transformation Practice

Deloitte's Technology & Transformation practice focuses on helping organizations unlock insights from complex data. Leveraging our global network, we provide strategic advice and implement solutions across business intelligence, data management, performance optimization, big data, cloud services, cognitive computing, and machine learning to empower fact-based decision-making.

Role Overview

We are looking for expert Azure Databricks Data Engineers to join our data modernization team. The role involves creating, developing, and sustaining scalable and robust data solutions on the Databricks platform. Your expertise in data engineering technologies will enable us to drive analytics and data-driven decisions for a diverse customer base.

Key Responsibilities

• Architect and deploy scalable, secure, and high-efficiency data architectures on Azure.
• Design and optimize ETL/ELT pipelines utilizing Azure Data Factory, Databricks, and Synapse Analytics.
• Implement ingestion, transformation, and storage strategies involving Azure Data Lake, Azure SQL, and Azure Synapse.
• Develop solutions for batch and real-time data using Azure services such as Delta Live Tables, Event Hubs, Stream Analytics, and Azure Functions.
• Utilize core tools including ADF, Databricks, Key Vault, ADLS, SQL Server or other RDBMS, Fabric, and Azure Synapse.
• Craft data models, schema designs, and optimized queries for performance enhancement.
• Handle structured, semi-structured, and unstructured data sources effectively.
• Maintain data governance, quality assurance, and security standards across all implementations.
• Deploy CI/CD pipelines for data solutions with Azure DevOps.
• Collaborate closely with data scientists, analysts, and business stakeholders to facilitate analytical insights.
• Diagnose and refine data workflows to ensure scalability and optimal performance.
• Optimize data solutions considering cost, scalability, and security within Azure environments.
• Implement comprehensive monitoring, logging, and alerting systems leveraging Azure Monitor and Log Analytics.

Additional Contributions

• Coordinate project management aspects including status updates and agile ceremonies.
• Engage with stakeholders to manage expectations and project priorities.
• Provide mentorship to junior data engineers and analysts.
• Offer technical guidance and oversee design reviews.
• Focus intently on user experience and problem-solving.
• Communicate effectively in diverse multicultural and multilingual teams.
• Exhibit initiative by managing deliverables independently and introduce innovative ideas and technologies.
• Regularly give and receive constructive feedback to improve workflows.

Soft Skills

• Active engagement with business leaders, developers, infrastructure, and security teams.
• Deep understanding of business requirements and negotiation of priorities.
• Proactive and self-driven approach to deliver cost-effective, performant solutions.

Qualifications and Certifications

• Minimum 5 years of professional experience in relevant data engineering roles.
• Graduation in any discipline including B.Tech, BE, MBA, BSc, MSc.
• Experience in regulated environments adhering to quality policies and procedures.
• Expertise in cloud-based development and deployment (Azure environment).
• Preferred certifications: Azure Data Engineer Associate, Azure Solutions Architect, Databricks Certification.

Location

The position is based in one of the following cities: Bengaluru, Hyderabad, Pune, Delhi, or Mumbai.

Eligibility

Candidates must have completed education such as BCA, B.Tech, BE, BSc, or Diploma in any specialization.