- Experience
- 5+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 5 days ago
- Work mode
- In office
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Overview
The position involves constructing and validating data pipelines on contemporary data platforms. Responsibilities include creating new data pipelines and products, automating processes, improving and supporting existing pipelines and products, and ongoing maintenance of these data solutions. The role supports data engineering tasks including ingestion, transformation, and consumption, while also providing technical services such as development, data preparation, transformation, encryption, masking, optimization, and testing preparation. Additionally, there is integration support leveraging the latest AI toolkits to accelerate development, testing, and deployment activities.
Required Skills and Expertise
- Proficiency in Python programming.
- Experience with PySpark for big data processing.
- Familiarity with Snowflake data warehousing platform.
- Hands-on experience with Databricks environment.
- Knowledge of Cloudera platform and migration processes involving Cloudera to Snowflake/Databricks using metadata-driven designs.
Experience Requirements
- At least five years of professional software coding and development experience.
- Solid grasp of data warehouse implementations and architecture.
- Practical experience in big data engineering, particularly developing and testing data pipelines using Python and PySpark on platforms such as Snowflake, Databricks, and Cloudera.