Principal Engineer - Distributed Systems and Data Platforms
Remote · Full Time
Be the first to apply
- Experience
- 11+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 1 week ago
- Work mode
- Work from home
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About the Role
This role involves joining a senior engineering team at an Australian technology company focused on creating a cutting-edge data platform. The Principal Engineer will maintain a hands-on technical focus, primarily working on distributed query processing, optimization, and supporting extensive enterprise deployments.
Key Responsibilities
- Design and develop distributed query execution and optimization techniques.
- Contribute to Apache Spark and Java Virtual Machine (JVM) engineering efforts.
- Implement query federation and pushdown mechanisms.
- Enhance system performance and scalability.
- Develop connector frameworks for data integration.
- Manage Kubernetes-based enterprise deployments.
- Address complex customer architecture and integration challenges.
Required Qualifications and Skills
- Minimum of 10 years software engineering experience.
- Expertise in distributed systems with deep knowledge of Apache Spark internals and query planning.
- Strong JVM programming skills using Scala, Java, or Kotlin.
- Proficient in SQL and query performance analysis.
- Experience with data platforms or query engines.
- Familiarity with Kubernetes, Linux, and containerized environments.
- Ability to engage effectively with customers and technical stakeholders.
Preferred Experience
Experience with technologies such as Databricks, Snowflake, Cloudera, Palantir, Starburst, Dremio, or Trino will be considered a significant advantage.
Additional Information
- This position allows remote work from anywhere in Australia.
- Compensation includes a competitive salary along with equity options.