Data Engineer

Position Overview

We seek an accomplished Data Engineer with over 5 years of professional experience skilled in architecting, building, and sustaining scalable data ecosystems. This role demands deep knowledge in data engineering, ETL/ELT pipelines, data consolidation, and cloud-based platforms.

Key Responsibilities

• Create, develop, and maintain scalable and dependable data pipelines.
• Construct and fine-tune ETL/ELT workflows for data integration from various sources.
• Design data models and oversee data warehouse and data lake management.
• Guarantee data integrity, precision, security, and accessibility.
• Collaborate with stakeholders to gather data needs and deliver solutions.
• Enhance data processing flows to boost pipeline efficiency.
• Monitor, diagnose, and fix issues in data pipelines and integrations.
• Work jointly with Data Scientists, BI Developers, Software Engineers, and business units.
• Uphold best practices in data governance, documentation, and security protocols.
• Participate in the design and deployment of cloud-based data platforms.

Mandatory Qualifications

• Experience exceeding 5 years in Data Engineering.
• Proficiency in Python programming and SQL querying.
• Background in developing ETL/ELT and data integration processes.
• In-depth knowledge of data warehousing, data lakes, and data modeling concepts.
• Familiarity with relational databases and NoSQL technologies.
• Hands-on experience with cloud platforms such as Azure, AWS, or Google Cloud Platform.
• Expertise with data processing technologies including Apache Spark.
• Understanding of Git version control, CI/CD pipelines, and DevOps methodologies.
• Preferred experience with workflow automation tools like Apache Airflow.
• Strong analytical thinking and problem resolution capabilities.
• Effective communication and teamwork skills.

Desirable Skills

• Familiarity with Databricks, Snowflake, Azure Data Factory, AWS Glue, or equivalent tools.
• Knowledge of Power BI or similar business intelligence and visualization software.
• Experience with real-time data and streaming technologies such as Kafka.
• Understanding of data governance, security compliance, and policies.
• Experience managing enterprise-scale data platforms.

Core Competencies

• Excellent problem-solving and analytical aptitude.
• Ability to work independently and collaboratively within a team.
• Strong communication and stakeholder management expertise.
• Capability to handle multiple tasks and meet project deadlines.
• Enthusiasm for learning and adapting to emerging technological trends.