- Experience
- 5–8 yrs
- Salary
- —
- Openings
- 1
- Posted
- 2 weeks ago
- Work mode
- In office
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About Nscale
Nscale is innovating beyond the hyperscalers by developing a fully integrated Generative AI cloud platform. We own and operate our own data centers, software, and applications that power modern AI infrastructure, prioritizing sustainable technology solutions. Our culture fosters relentless innovation, ownership, and accountability, where team members take pride in delivering excellence with urgency. We emphasize openness, transparency, swift and respectful collaboration, adaptability, and resilience.
Role Overview
We are seeking a Senior AI Product Engineer to join our product engineering team. This role involves leading the technical design and execution of significant features and subsystems, serving as the technical cornerstone of your team and elevating the quality across all deliverables.
The position includes ownership of key segments of Nscale's AI services platform such as the API gateway, core AI functionalities, billing and usage infrastructure, and developer SDKs/tooling. You will manage complex, multi-sprint projects through to completion, while mentoring junior engineers.
Beyond project delivery, you will amplify the impact of those around you by nurturing team members, influencing how challenging problems are approached, and shaping the technical direction of the products.
Responsibilities
- Lead architectural design and end-to-end implementation for critical product subsystems and intricate features.
- Make key architectural decisions including API design and deployment strategies within your team’s scope.
- Elevate quality standards through strong emphasis on testing, observability, reliability, and incident handling.
- Mentor junior engineers via design/code reviews and collaborative programming.
- Work cross-functionally with AI platform, infrastructure, and product teams to align efforts.
- Proactively identify and mitigate technical debt and scalability issues.
- Engage in recruitment activities including reviewing candidate applications and conducting interviews.
- Prepare thorough design documentation that supports asynchronous team decisions.
Requirements
- Between 5 and 8 years of experience in software engineering.
- Strong backend or full-stack development skills with languages such as Python, TypeScript, Go, or equivalents.
- Demonstrated expertise designing and managing API platforms or developer-facing cloud services.
- Proven ability to lead and deliver complex, multi-sprint projects end-to-end.
- Experience with cloud-native architectures including Kubernetes, distributed systems, and observability tools.
- Knowledge of building services featuring control plane and data plane separation, and familiarity with cloud service scalability architectures like cell or ring-based patterns.
- Effective communication skills to articulate technical decisions clearly to product managers and engineering stakeholders.
- Sound engineering judgment to balance simplification, investment, and deferral appropriately.
Preferred Qualifications
- Experience creating or using SDKs, Terraform providers, or extensibility mechanisms for cloud platforms.
- Familiarity with infrastructure as code tools such as Terraform or Pulumi, particularly how platform teams expose these to users.
- Background developing AI-integrated features including LLM inference APIs, fine-tuning workflows, or agentic workflows.
- Working knowledge of AI/ML infrastructure topics like serving, evaluation, and model lifecycle management.
Additional Information
Candidate data is handled in accordance with Nscale's Employee & Candidate Privacy Notice.