Senior Data Engineer

Position Overview

We are seeking an experienced Senior Data Engineer with over 8 years of expertise to join our team in Bengaluru, Karnataka. This role requires working onsite with shift timings from 2 PM to 11 PM IST and an immediate notice period of up to 15 days.

Key Responsibilities

• Design and optimize complex SQL queries with a focus on performance tuning, query optimization, and data validation across diverse data sources.
• Develop and maintain data processing pipelines using programming languages such as Python, SQL, and Scala; familiarity with Java is advantageous.
• Leverage machine learning frameworks, including Spark, Databricks, TensorFlow, scikit-learn, and PyTorch, to support analytics initiatives.
• Utilize cloud platforms, primarily AWS, to manage storage, compute, orchestration, and monitoring services; experience with Azure or GCP is a plus.
• Implement and support BI and analytics platforms such as SigmaComputing, Tableau, PowerBI, or MicroStrategy to enable self-service and operational reporting.
• Ensure adherence to data governance standards, data quality, lineage, and compliance with regulations like GDPR and SOX through practical application of RBAC, encryption, and secure design principles within cloud environments.
• Analyze extensive and complex multidimensional datasets, both structured and unstructured, to generate actionable insights and facilitate advanced analytics and machine learning projects.
• Stay current with Generative AI technologies and modern machine learning methods, including large language models, transformers, ensemble approaches, and deep learning, integrating these concepts into data engineering workflows.

Additional Information

• Working hours are from 2 PM to 11 PM IST.
• Immediate availability or a notice period not exceeding 15 days is required.