Data/Analytics Lead
Noida, Uttar Pradesh, India · Full Time
Be the first to apply
- Experience
- 6+ yrs
- Salary
- INR 2,500,000 – INR 3,200,000 / year
- Openings
- 1
- Posted
- 3 days ago
- Work mode
- In office
- Education
- Computer Science Engineering degree
- Eligibility
- Candidates with at least 6 years of relevant experience and a background in Computer Science Engineering are eligible to apply.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About the Role
Join a pioneering technology firm focused on creating sovereign, secure, and scalable digital platforms integrating AI, Web3.0, cloud solutions, and health-tech innovations. This leadership position involves directing the creation and execution of a cutting-edge analytics platform exclusively utilizing open-source technologies. You will oversee the construction of robust data pipelines, a lake house architecture, and a comprehensive BI infrastructure from the ground up, while leading a team of 4-6 data engineers.
Key Responsibilities
- Lead and mentor a team of 4-6 data engineers, steering platform architecture and strategic planning.
- Develop the entire analytics platform architecture on an open-source foundation.
- Construct a data lake house employing Cloudian object storage and architect OLAP solutions with ClickHouse for sub-second query performance.
- Design and implement data ingestion from multiple sources including APIs, databases, and SaaS applications, supporting both real-time and batch processing.
- Construct data pipelines with Airbyte emphasizing CDC, connectors, and validation; orchestrate workflows via Apache Airflow ensuring DAG creation, monitoring, and error management.
- Devise incremental and full-load data extraction strategies and incorporate Kafka for streaming data management.
- Enhance ClickHouse performance using materialized views and distributed tables; develop dimensional data models like star and snowflake schemas.
- Build semantic layers to ensure consistent metric definitions and deploy BI platforms such as Apache Superset, with optional Power BI integration, and implement Redis caching to boost responsiveness.
- Enforce data quality and governance by applying frameworks like Great Expectations and Soda, automate data reconciliation, and maintain data lineage, cataloging, and adhere to GDPR compliance.
- Develop Python automation scripts and custom connectors; initiate CI/CD pipelines for data workflows and optimize operational costs and system performance.
Candidate Eligibility
Applicants must have a minimum of six years of professional experience and hold a degree in Computer Science Engineering or a related field.
Compensation and Additional Details
The annual salary range for this position is ₹2,500,000 to ₹3,200,000. The position is located onsite in Noida, Uttar Pradesh, India. Immediate joining is preferred.
Perks
Successful candidates will receive an official job offer from the company.
Minimum education
Bachelor's Degree