Lead Data Engineer

About the Role

TechWise Digital is seeking a seasoned Lead Data Engineer to architect, build, and enhance scalable data platforms and ETL pipelines leveraging AWS technologies. The ideal candidate will wield over eight years of hands-on experience, with specialized knowledge in AWS Glue, AWS Lambda, Amazon Redshift, Aurora PostgreSQL, MSK Kafka, AWS SQS, Apache Airflow, SQL, and Python.

Key Responsibilities

• Design and implement high-performance, scalable data pipelines on AWS cloud infrastructure.
• Optimize and maintain data workflows to ensure maximum efficiency and reliability.
• Uphold data quality standards through rigorous measures and monitoring.
• Manage production data environments and quickly resolve critical incidents classified as P1 or P2 within agreed SLA timeframes.
• Troubleshoot and analyze complex data issues to provide timely resolutions.
• Collaborate closely with Data Leads, Application Development teams, and other stakeholders to deliver robust and scalable data solutions.

Required Skills and Experience

• Extensive experience (8+ years) in production pipeline management and performance tuning.
• Deep knowledge of data warehousing concepts and cloud-native data engineering practices.
• Proficient in AWS Glue, AWS Lambda, Redshift, Aurora PostgreSQL, MSK Kafka, AWS SQS, and Apache Airflow orchestration.
• Strong command of SQL and Python for data processing and automation.
• Excellent analytical and problem-solving capabilities.
• Effective communication and stakeholder management skills.