- Experience
- 5+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 20 hours ago
- Work mode
- In office
- Education
- Bachelor's or Master's in Computer Science or related field
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About Kape Technologies
Kape Technologies is a cybersecurity firm dedicated to enhancing digital privacy and protection, aiming to create a safer online environment. The company employs over 1000 professionals across ten global offices including Singapore, the UK, and the USA.
Job Summary
We are looking for an expert Senior Data Engineer to design and manage advanced data infrastructure and pipelines. This role entails constructing a scalable data platform that supports analytics, insights, and automated workflows to enable informed decisions company-wide. Collaboration with analysts, product teams, and engineers is essential to create comprehensive data solutions utilizing top cloud technologies like AWS Redshift, Athena, and Snowflake.
Key Responsibilities
- Build and maintain scalable data pipelines handling large volumes of structured and unstructured data from multiple sources.
- Develop resilient data warehouse systems using AWS Redshift, Athena, and Snowflake.
- Refine data models and optimize queries and storage to enhance performance, scalability, and cost efficiency.
- Work with analytics, product, payments, and finance teams to understand needs and deliver data solutions that drive business objectives.
- Implement best practices in data governance, testing, and monitoring to ensure data quality, security, and privacy.
- Manage production data workflows, handle incidents, and maintain workflow reliability.
- Develop infrastructure suited for analytics and AI tasks, including transformation and semantic layers.
- Create and supervise automated data access workflows promoting reliable, scalable, and precise data availability to users across the organization.
Technical Stack
- Programming: Python, SQL
- Data Warehousing & Query Engines: Snowflake, AWS Redshift, Athena
- Pipeline Orchestration: Apache Airflow, AWS Glue, dbt
- Cloud & DevOps Tools: AWS Lambda, S3, IAM, Docker, Terraform
- Streaming Services: Kafka, Kinesis
- BI & Analytics Platforms: Tableau, Power BI
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related discipline.
- Minimum 5 years of experience as a Data Engineer focusing on pipeline creation and data warehousing.
- Expertise in Snowflake or AWS Redshift.
- Strong Python and SQL programming abilities.
- Proven experience developing LLM-driven applications or workflows for analytical purposes, with interfaces like 'ask your data'.
- Experience with pipeline orchestration tools such as Airflow, AWS Glue, or dbt.
- Comprehensive knowledge of data modeling, schema design, and ETL/ELT methodologies.
- Excellent analytical, problem-solving, and communication skills.
- Capability to collaborate across departments and guide junior team members.
- Experience working in fast-paced, product-driven, or SaaS environments.
Desirable Qualifications
- Knowledge of AWS infrastructure and DevOps methodologies.
- Understanding of data privacy and security compliance such as GDPR and SOC2.
- Insight into agent architectures, prompt engineering, and evaluation processes.