Lead Scala Developer - Data Engineering with Java, Kafka, Azure, Spark at Leading German MNC

Company Overview

Join a prestigious German multinational corporation located in Bangalore, seeking an experienced Lead Scala Developer to contribute to transformative data engineering projects.

Role Overview

As a Lead Scala Developer in Data Engineering, you will design and deliver highly reliable, production-grade, data-centric applications that facilitate critical global business functions. Your role involves cross-domain responsibilities including backend service development, cloud-native infrastructure management, and data pipeline maintenance with strong emphasis on scalability, reliability, and maintainability.

Primary Responsibilities

• Develop and manage end-to-end system architectures involving microservices, event-driven systems, and data platforms.
• Create durable backend services and APIs ensuring security, scalability, and high availability.
• Implement and maintain cloud-native infrastructure leveraging Kubernetes and adhere to platform engineering best practices.
• Construct and sustain data pipelines utilizing Spark and Databricks as needed.
• Lead event-driven architecture design, particularly employing Kafka and streaming technologies.
• Produce clean, maintainable, and testable software primarily using Scala, with Python where suitable.
• Lead architecture and design peer reviews, preparing succinct design documentation to support major technical decisions.
• Enhance engineering standards focusing on testing, observability, continuous integration/continuous deployment (CI/CD), and system reliability.
• Mentor software engineers at various levels through code reviews, collaborative design discussions, and pairing sessions.
• Ensure built-in observability from the start, covering metrics, logging, tracing, alerting, and service level objectives (SLOs).
• Deploy solutions via CI/CD pipelines incorporating strategies for safe releases, rollbacks, and progressive delivery.

Required Qualifications and Skills

• Minimum 8 years’ experience in software engineering focused on backend, platform, or data-driven domains.
• Strong proficiency in Scala or Java programming; Scala expertise preferred.
• Demonstrated experience building distributed microservices and event-driven architectures, especially within the Scala/JVM ecosystem using tools like KStreams, Flink, cats-effect, fs2, and tapir.
• Hands-on production experience with Kafka at scale.
• Expertise in designing and developing APIs both RESTful and event-driven.
• Thorough knowledge of relational database systems like PostgreSQL, including data modeling and query performance optimization.
• Experience developing distributed data processing pipelines using Spark and/or Databricks.
• Proven leadership in guiding technical design and architectural decisions across teams.
• Experience in coaching and mentoring engineering personnel.

Preferred Skills

• Familiarity with Kubernetes workloads, networking, Helm charts, scaling mechanisms, and operational procedures.
• Understanding of data governance concepts, lakehouse table formats such as Delta and Iceberg, plus modern data platforms.
• Background in platform engineering including building developer-centric platforms, standardized workflows, or internal tooling.
• Skills in performance profiling and tuning of the Java Virtual Machine (JVM).
• Experience integrating MLOps or data science platforms.

Collaboration and Leadership Scope

• Work collaboratively with domain and platform teams to interpret complex requirements into resilient and efficient system designs.
• Engage with technical and organizational leadership to influence cross-team technical strategies.
• Facilitate consensus regarding engineering standards and best practices across engineering groups.
• Participate in incident management, root cause analysis, and continuous improvement of system reliability.
• Contribute to product roadmaps balancing strategic business objectives with technical sustainability and platform robustness.

Eligibility and Educational Requirements

Applicants must have a Bachelor’s degree in Computer Science, Computer Engineering, or an equivalent technical discipline. A Master’s degree is preferred.