Job Description
Data engineers should have experience working with Azure data platform or MS fabric platform using Azure data factory (ADF) for ingestion, Databrics/Synapse notebooks for engineering and delta lake on top of ADLS for storage.
- Experience developing ADF pipelines/Fabric pipelines
- Experience in pyspark – writing pyspark notebooks in Databricks/Synapse
- Experience with ADLS and delta lake
- Preferred if experienced in working with MS Fabric lakehouse and SQL Endpoint