Senior AI/LLM Engineer (Python) - Remote

About Kake

Kake is a globally distributed, remote-first company fostering a community of senior engineers involved in creating cutting-edge products for Fortune 500 companies and high-growth startups. With over 45,000 engineers in more than 55 countries, Kake values the contributions of its members over physical location, promoting a culture of growth, retention, and collaboration.

Role Overview

We are seeking experienced Senior AI/LLM Engineers proficient in Python to design, develop, and deploy scalable AI-driven and large language model (LLM) applications. The role involves full ownership from prototype creation through to deployment in production environments, requiring expertise at the intersection of software engineering and applied AI.

Key Responsibilities

• Architect, implement, and launch features and applications powered by LLMs using Python.
• Develop and maintain backend services and APIs utilizing frameworks like FastAPI to expose AI/LLM functionalities.
• Create and optimize retrieval-augmented generation (RAG) pipelines including embedding creation, vector search, and retrieval methodologies.
• Design, test, and refine prompts, agents, and orchestration workflows using frameworks such as LangChain or LlamaIndex.
• Integrate LLM providers (e.g., OpenAI, Anthropic, or open-source models), managing trade-offs in cost, latency, and output quality.
• Systematically evaluate model outputs by creating tooling and metrics to monitor accuracy, safety, and performance regressions.
• Utilize containerized environments and manage data infrastructures like PostgreSQL, Redis, and vector databases to ensure reliable AI production systems.
• Collaborate closely with cross-functional teams to convert ambiguous product requirements into robust AI solutions.

Essential Qualifications

• Expertise in Python programming and experience with backend web frameworks such as FastAPI.
• Proven experience working with LLM APIs and AI frameworks including LangChain and LlamaIndex.
• Familiarity with retrieval-augmented generation (RAG) architectures, embeddings, and vector databases such as Pinecone, Weaviate, or pgvector.
• Hands-on experience with Docker for containerized development and deployment.
• Strong knowledge of data storage systems like PostgreSQL and Redis.
• Proficiency in writing both functional and integration tests and building evaluation frameworks for AI output quality assurance.
• Excellent verbal and written communication skills in English.
• Capability to work independently and efficiently in a remote, fast-paced setting.

Preferred Skills

• Experience fine-tuning or assessing open-source LLMs.
• Knowledge of prompt engineering best practices and agent workflows.
• Exposure to distributed systems, streaming platforms such as Kafka, or large-scale application environments.
• Foundation in machine learning concepts using libraries such as scikit-learn, PyTorch, or TensorFlow.
• Willingness to work flexible hours enabling daily 5-6 hour overlap with US Pacific Time Zone teams.

Additional Information

• Daily 5-6 hour overlap with US Pacific Time Zone for collaboration.

Why Work at Kake?

• Competitive compensation paid in USD enabling global opportunities.
• Fully remote work environment supported by a culture of trust.
• Personal growth investment through the Better Me Fund supporting individual passions.
• A compassionate community focused on social impact and well-being.

Note: Given the volume of applications, only shortlisted candidates will be contacted.