Senior Data Engineer (Python / AWS / ML Pipelines)

About the Role

This opportunity is offered on behalf of a partner organization based in Saudi Arabia seeking an experienced Senior Data Engineer specialized in Python, AWS, and machine learning pipeline development. The successful candidate will be responsible for developing and maintaining robust, large-scale data and ML workflows, ensuring efficient production deployment of forecasting and data-driven solutions.

Key Responsibilities

• Construct, operate, and enhance reliable production data and machine learning pipelines that support forecasting and decision-making.
• Develop scalable, maintainable ETL and data transformation workflows using Python.
• Design and manage workflow orchestration leveraging tools such as Apache Airflow and AWS Step Functions.
• Utilize AWS Glue for comprehensive data processing and execution of pipelines.
• Deploy and operationalize machine learning models through AWS SageMaker.
• Collaborate closely with Data Scientists and ML Engineers to transition analytical models into dependable production environments.
• Continuously monitor pipeline performance and troubleshoot issues to improve scalability, reliability, and efficiency.
• Participate in architecture and technology discussions to enhance the data platform and ML infrastructure.
• Work effectively within distributed Agile teams, contributing to technical excellence and process improvements.

Candidate Requirements

• Extensive professional experience in Python, particularly in data engineering and production system development.
• Proven track record in designing, building, and maintaining data and ML pipelines in live environments.
• Strong hands-on expertise with Apache Airflow for workflow management.
• Practical experience operating AWS Step Functions and AWS Glue services.
• Competence in deploying and managing machine learning models via AWS SageMaker.
• In-depth knowledge of AWS cloud services and operating production environments in the cloud.
• Experience handling high-scale systems with a focus on stability and performance optimization.
• Ability to work in close coordination with Data Scientists, ML Engineers, and other technical stakeholders.
• Excellent problem-solving skills and analytical thinking.
• Strong English communication skills, both verbal and written.
• Capable of functioning independently and collaboratively within distributed, cross-functional teams.
• Familiarity with Google Cloud Platform (GCP) and monitoring/observability tools is beneficial but not mandatory.

Benefits

• Collaborative workplace where decision-making responsibilities are shared among team members.
• Agile work culture that encourages contributing ideas and influencing technological directions.
• Support for learning through mistakes and continuous improvement of operational practices.
• Access to diverse projects to broaden technical expertise.
• Ongoing professional development opportunities including training and mentoring.
• Career advancement possibilities and exposure to the latest technologies.
• Potential for business travel assignments.
• Flexible work arrangements fitting a distributed team environment.
• Additional remuneration, healthcare, and benefits subject to local conditions in Slovenia.