About
Azure Data Engineer with 2+ years of experience in Databricks administration, PySpark/SQL development, and production support for a Retail IoT data platform. Built and maintained Medallion Architecture pipelines on Delta Lake and independently delivered end-to-end batch ETL projects using Azure Data Factory, Unity Catalog, and Azure Synapse Analytics.
Experience
-
Azure Data EngineerLTIMindtree · Hyderabad, IndiaJun 2024 – Present
Support a production Retail IoT platform, build and maintain PySpark/SQL pipelines across Bronze, Silver, and Gold layers, administer Databricks workspaces and Unity Catalog governance, and resolve production incidents across ADF, Databricks, and downstream databases.
Education
-
2023
B.TechGayatri Vidya Parishad College of Engineering (A), Visakhapatnam2023
Skills
Tools / apps / platforms
Projects
-
2021 Olympics Analytics Pipeline — ADF + Databricks + SynapseAzure Data Factory, ADLS Gen2, Azure Databricks, Azure Synapse Analytics, Delta Lake
Built an end-to-end pipeline ingesting public datasets, processed data through Bronze/Silver/Gold Delta layers, and enabled ad-hoc SQL querying and visualization in Synapse.
-
Retail Sales Batch ETL Pipeline — Delta LakePySpark, ADLS Gen2, Delta Lake, Azure Data Factory, Azure Monitor
Built a batch ETL pipeline processing 10,000+ sales records, implemented cleansing and aggregations, applied Delta Lake performance features, and automated execution via ADF Event Triggers.
-
Healthcare Data Platform — Unity Catalog GovernanceADLS Gen2, Azure Data Factory, Unity Catalog, Azure Synapse Analytics, PySpark, Databricks
Designed an end-to-end Medallion Architecture pipeline across 10 healthcare datasets, configured secure Databricks connectivity, built governed Delta tables, and automated the pipeline with a scheduled Databricks Job.