Consultant Data Engineer with Azure Databricks Expertise
Crescendo Global Leadership Hiring India
Hyderabad, Telangana, India · Full Time
Be the first to apply
- Experience
- 6+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 5 دن قبل
- Work mode
- In office
- Education
- Any graduate
- Eligibility
- Any graduate eligible to apply.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About the Role
We are seeking an experienced Data Engineer proficient in Azure Databricks to architect, develop, and fine-tune scalable data solutions. You will be instrumental in crafting modern data pipelines and implementing Lakehouse architecture while collaborating closely with various cross-functional teams to provide enterprise-level analytics solutions. This role is based at locations in Bangalore, Hyderabad, or Gurgaon.
Key Responsibilities
- Design and implement scalable data pipelines utilizing PySpark, Spark SQL, and Azure Databricks.
- Create and oversee ETL workflows using Azure Data Factory (ADF).
- Develop and sustain Lakehouse architecture with Azure Data Lake Storage (ADLS) alongside Databricks.
- Maintain high data quality through cleansing, transformation, monitoring, and promptly resolving issues.
- Work collaboratively with DevOps, Data Science, and Business Intelligence teams to deliver robust analytics solutions.
Requirements
- At least 6 years of professional experience in Data Engineering roles.
- Strong practical knowledge of Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage (ADLS).
- Advanced skills in PySpark, Spark SQL, and SQL.
- Deep understanding of ETL methodologies, data pipeline creation, and data transformation techniques.
- Experience operating within cloud-based analytics platforms and excellent problem-solving abilities.
What We Offer
- Opportunity to engage in expansive cloud and data engineering projects.
- Exposure to cutting-edge Azure services and Lakehouse frameworks.
- Dynamic and innovation-friendly work environment promoting collaboration.
- Exceptional career advancement prospects and continuous learning opportunities.
- Competitive salary packages with comprehensive benefits.
Additional Information
This position is open to any graduate. The recruitment process emphasizes equal opportunity, prohibiting discrimination based on race, religion, gender, age, disability, or other protected categories. Only selected candidates will be contacted. If you do not receive communication within a week, your profile has likely not been shortlisted.
Minimum education
Bachelor's Degree