- Experience
- 5+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 4 days ago
- Work mode
- In office
- Education
- Any graduate
- Eligibility
- Candidates must be graduates in any discipline.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Overview
Join Alike Thoughts Solutions Pvt. Ltd. as an Azure Data Engineer based in Hyderabad, India. This role involves architecting and enhancing data pipelines utilizing Azure Databricks and PySpark within a cloud ecosystem.
Key Responsibilities
- Design, build, and enhance ETL pipelines leveraging Databricks and PySpark frameworks.
- Handle data integration processes incorporating diverse formats such as Parquet, Delta, JSON, and CSV from Azure Data Lake Storage Gen2 (ADLS Gen2).
- Conduct performance optimization of Spark SQL queries, adjust cluster setups, and implement effective partitioning techniques.
- Implement Continuous Integration/Continuous Deployment (CI/CD) practices using tools like GitHub Actions or Azure DevOps for workflow automation.
Required Skills and Qualifications
- Minimum five years of experience in IT with at least two to three years specialized in Databricks environment.
- Proficient in Python programming, PySpark scripting, and SQL querying.
- Good working knowledge of Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS Gen2), and Azure SQL database services.
Eligibility
Open to any candidates holding a graduate degree.
Minimum education
Bachelor's Degree