Platform Engineer for AI/ML Infrastructure

Overview

We are seeking a proficient Platform Engineer to deploy and oversee AI/ML infrastructure components such as LlamaIndex Cloud and KDB.AI applications within a Kubernetes environment. The role involves constructing dependable, scalable, and secure deployment pipelines by leveraging modern GitOps methodologies.

Key Responsibilities

• Deploy and manage AI workload platforms like LlamaIndex Cloud and KDB.AI across development, QA, and production settings.
• Develop and maintain automated deployment workflows using GitOps tools such as Flux CD.
• Administer Kubernetes clusters spanning multiple environments to ensure stability and performance.
• Configure secrets management via HashiCorp Vault and enable ExternalSecrets integration.
• Oversee continuous integration and continuous delivery pipelines utilizing GitHub Actions and Artifactory.
• Collaborate with enterprise Identity Management teams to set up OIDC authentication integrated with Microsoft Entra ID.
• Create and upkeep Helm charts and Kubernetes manifests for reliable deployment.
• Monitor application performance and troubleshoot issues occurring in production environments.
• Document operational procedures, runbooks, and infrastructure design patterns to support and maintain system reliability.

Essential Skills and Experience

• Minimum of 3 years managing production-grade Kubernetes clusters.
• At least 2 years experience working with GitOps tools such as Flux CD or ArgoCD.
• Advanced capability in creating and managing Helm charts.
• Familiarity with HashiCorp Vault for secure secrets management.
• Experience using Artifactory or equivalent container registries.
• Proficient with CI/CD tooling, including GitHub Actions and Jenkins or similar platforms.
• Database administration experience for PostgreSQL, MongoDB, Redis, and RabbitMQ including high availability and failover solutions like PgBouncer and HAProxy.
• Strong background in Linux/Unix systems including shell scripting in Bash and PowerShell.
• Knowledgeable about Kubernetes networking, Ingress controllers, and Gateway APIs.

Desirable Qualifications

• Exposure to AI/ML platforms such as LlamaIndex or LangChain.
• Experience with vector databases or KDB.AI applications.
• Familiarity with workflow orchestration tools like Temporal.io.
• Programming skills in Python or Go for automation tasks.