Big Data Engineer

Overview

As a Big Data Engineer, you will design, develop, and optimize data pipelines and infrastructures to enhance reporting, analytics, and business intelligence capabilities throughout the company. This role involves handling diverse data sources to guarantee dependable, precise, and accessible data for both operational activities and strategic decision-making.

Key Responsibilities

• Create and manage scalable batch and streaming data pipelines utilizing Python and Apache Spark technologies.
• Construct and oversee data transformation processes leveraging dbt to maintain data precision, uniformity, and quality standards.
• Extract, amalgamate, and verify data from several operational platforms and internal databases to support organizational needs.

Qualifications

• Possess a Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or related disciplines.
• Have a minimum of two years of experience in Data Engineering, Data Integration, Business Intelligence, or a similarly technical position.
• Demonstrated expertise in Python programming, SQL querying, Apache Spark/PySpark frameworks, and dbt tools.