Data Engineer

Overview

Reporting to the Senior Manager of Data Science & Analytics, the Data Engineer is accountable for architecting and maintaining robust data pipelines, documenting data models, integrating diverse data sources, and designing scalable data storage solutions. Collaboration with data science teams is central to crafting appropriate data-driven solutions.

Key Responsibilities

• Support quality assurance in both quantitative and qualitative research initiatives.
• Develop, maintain, and optimize data processing pipelines using cloud platforms such as AWS, Azure, or GCP.
• Engage with business analysts to comprehend business needs and use cases.
• Create and implement quality assurance protocols and testing scripts.
• Construct data pipelines for survey and voter file datasets.
• Design and develop data assets employing cloud technologies and Oracle Data Integrator (ODI).
• Build internal tools to streamline complicated task workflows.
• Architect schemas, data models, and infrastructure for cloud environments.
• Develop scripts for data flow automation using Unix and scripting languages.
• Automate repetitive data processing tasks through scripting and workflow creation.
• Collaborate with the data team to pinpoint automation opportunities and develop efficiency-enhancing tools.

Essential Skills and Competencies

• Effective communication and teamwork across regional teams.
• Self-driven mentality with commitment to meet deadlines and assist colleagues.
• Strong problem-solving skills to simplify and resolve complex challenges.
• Adept at decomposing intricate problems into manageable solutions.

Educational and Professional Qualifications

• Bachelor’s degree in Data Science, Computer Science, Actuarial Science, Information Systems, Economics, Statistics, or related quantitative disciplines.
• Proficiency in Python programming language.
• Solid experience with SQL querying.
• Understanding of star schema design and data warehouse concepts.
• Hands-on experience with cloud services including AWS and Azure.
• Advantageous to have ETL/ELT expertise, encompassing batch and microservices-based approaches.
• At least three years of relevant experience as a data engineer or in a comparable role.
• Familiarity with data pipeline orchestration and workflow tools like Apache Airflow.

Additional Information

KQ Health operates as an equal opportunity employer welcoming qualified candidates irrespective of diverse protected characteristics and will provide accommodations upon request during hiring. Applicants requiring assistance with the recruitment process due to disability are encouraged to reach out for support.