- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 1 day ago
- Work mode
- In office
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About xAI
xAI is committed to developing artificial intelligence systems that deeply comprehend the universe and support humanity's quest for knowledge. The team is small but highly driven, valuing engineering excellence and a flat structure where everyone actively contributes. Ideal candidates thrive on curiosity, exhibit strong work ethics, prioritize effectively, and communicate clearly and succinctly within the team.
Role Overview
This role focuses on constructing robust backend systems, primarily in Rust or similar compiled languages like C++ or Go, to support scalable, reliable production infrastructure. The successful engineer will build and maintain the xAI API that delivers models to users globally.
Key Responsibilities
- Develop and maintain the xAI API enabling worldwide developer access to AI models.
- Manage the comprehensive system responsible for high-throughput inference, processing billions of tokens per minute with minimal delay and maximum uptime.
- Oversee components such as model serving infrastructure, request routing, SDK creation, rate limiting, monitoring, and efficient scaling.
Basic Qualifications
- Proven expertise in either Rust or C++ programming languages.
- Demonstrated experience designing and operating reliable, horizontally scalable distributed systems.
- Strong understanding of observability and reliability best practices in service management.
- Operational experience with databases like PostgreSQL, Clickhouse, and MongoDB.
Preferred Skills and Experience
- Background with large language model (LLM) inference engines and serving frameworks such as SGLang, TensorRT, or vLLM.
- Experience designing or integrating agent SDKs and orchestration frameworks.
- Familiarity with container technologies including Docker and Kubernetes.
- Advanced knowledge of gRPC including unary calls, streaming, and REST mappings.
Additional Information
xAI values diversity and is an equal opportunity employer. Details regarding data management during recruitment are available in the company's Recruitment Privacy Notice.