Senior MaaS Backend Engineer

About Bitdeer

Bitdeer is an innovative technology firm specializing in comprehensive Bitcoin mining and advanced computing solutions. Their portfolio includes SEALMINER hardware, cooling technology like Minerbase containers, cloud and co-mining services, marketplace platforms for mining rights, and extensive data center operations globally. They also offer AI cloud infrastructure encompassing GPU computing, training, deployment, and enterprise-grade turnkey solutions. The company is headquartered in Singapore and carries a worldwide operational reach.

Role Overview

This role entails co-owning the architecture of the MaaS (Model as a Service) backend system, developing inference APIs and routing mechanisms compatible with it, while enhancing system performance and reliability on a global scale. Responsibilities include implementing crucial features such as security, identity verification, metering, billing, migrations, observability, and data retention policies. You will also take a lead role in mentoring the engineering team and guiding technical developments.

Primary Responsibilities

• Collaborate in the design and technical execution of the MaaS backend system.
• Manage compatibility and versioning for inference gateways and APIs.
• Develop intelligent routing based on load, implement circuit breakers, and fallback procedures.
• Enhance token throughput, improve caching strategies, reduce latency, and manage autoscaling effectively.
• Scale inference pools across regions and maintain active-active control planes.
• Define, monitor, and uphold service-level objectives (SLOs).
• Ensure secure authorization, maintain multi-tenant isolation, and manage API key permissions and rate limits.
• Build exactly-once metering systems for tokens and maintain usage ledgers.
• Carry out incremental system migrations using shadow traffic techniques and dual writes.
• Implement request tracing, gather cost telemetry, and enforce log retention policies.

Required Experience & Skills

• At least eight years of backend engineering experience.
• Minimum three years managing a high-traffic, multi-tenant API platform servicing paying customers.
• Expertise in multi-region active-active distributed systems, with emphasis on caching, managing backpressure, and performance tuning.
• Proven experience in seamless, zero-downtime migrations for stateful back-end systems.
• Proficiency with Go programming language, Kubernetes orchestration, Envoy proxies, and GPU-aware workload scheduling.
• Familiarity with PostgreSQL, Redis, Kafka messaging systems, OpenTelemetry tracing, and high-cardinality analytics databases.
• Knowledge of large language model (LLM) serving, server-sent event (SSE) streaming, key-value caching, and trade-offs related to throughput.
• Experience in designing metering and billing systems with exactly-once semantics.
• Ability to engineer fail-closed authorization mechanisms emphasizing cross-tenant isolation.
• History of handling on-call duties and conducting incident post-mortems.

Additional Notes

The position requires physical presence in Singapore for full-time onsite engagement.